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Introductory  Statement 

The  purpose  of  this  work  is  to  make  a careful  study  of  the 
history  and  development  of  tests  and  examinations, -their  pur- 
pose, their  form,  their  merits  and  abuses. 

Webster,  in  the  New  International  Dictionary,  states  that 
an  Examination  is  an  act  of  examining,  or  state  of  being  exam- 
ined; a search  or  investigation;  scrutiny  by  study  or  experi- 
ment. A process  prescribed  or  assigned  for  testing  qualifica- 
tions. 


An  effort  has  been  made  to  compile  into  one  convenient 
volume  outstanding  facts  apropos  to  the  history  and  develop- 
ment of  tests  and  examinations,  (exclusive  of  the  so-called  in- 
telligence tests). 

Because  of  the  multiplicity  of  publications  and  research 
i appurtenant  to  this  field  of  view;  it  is  evident  that  a single 
i volume  could  not  be  complete,  however,  it  is  the  hope  of  the 
arranger  that  with  the  available  bibliography  of  about  600  refer 
ences  and  the  carefully  detailed  index  it  will  prove  very  usable 


and  profitable. 

In  addition,  definite  references  of  available  materials 
regarding  the  measurement  of  many  specific  school  subjects  and 
the  addresses  of  publishers  of  Educational  Tests,  are  given  in 
order  that  this  contribution  to  Education  may  be  of  definite 
practical  value. 
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Hi  .story  of  Examinations 


There  was  in  China,  2200  years  before  Christ,  a system  of 
examinations  for  the  purpose  of  selecting  officers  for  the  gov-- 
eminent  service.  This  continued  until  A.  D.  1906,  when  it  was 
abolished,  and  as  a partial  substitute  an  annual  examination 
was  held  in  Peking  of  Chinese  graduates  educated  abroad.  1. 

Socrates,  the  Athenian  philosopher,  in  400  B.  C. , asked 
profound  and  searching  questions  of  those  with  whom  he  chanced 
to  converse.  His  methods  and  purposes  were  comparable  to  the 
accepted  procedure  of  educational  practices  of  today.  2. 

Sometime  after  307  B,  C.  special  aptitudes  of  pupils  be- 
came noted  and  developed  within  a sort  of  conservatoire  of  musi 
at  Alexandria,  where  poor  boys  with  good  natural  voices  were 
supported  and  trained.  There  were  competitions  which  were  in 
the  form  of  a school  examination  with  prizes.  There  were  also 


c 


examinations  held  to  test  the  qualification  for  a post.  3. 


; 1*  For  more  complete  details  see  Encyclopaedia  Britannica  El- 

eventh Edition  Vol.X  page  35,  and  Lang,  Modem  Methods  in 
Written  Examinations  page  135  in  Part  11. 

2.  Robinson  and  Breasted  OUTLINES  OF  EUROPEAN  HISTORY,  see 
page  37,  and  Lincoln  Library  page  1628 

j 3.  Mahaffy,  J.  P. , GREEK  LIFE  AND  THOUGHT,  Macmillan  Co.,  1887 
See  page  185  in  Part  11. 
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The  Catechetical  method  of  questions  and  answers,  which  was 
begun  in  the  Catholic  Church,  reached  its  fullest  development  in 
the  3rd  and  4th  centuries,  and  has  continued  down  through  the 
ages.  1* 

The  12th  and  13th  centuries  marked  the  beginning  of  the 
Medieval  universities.  Disputation,  determination,  defense  of  j 
a thesis,  or  the  delivery  of  a public  lecture  are  some  of  the 
forms  which  examinations  took  at  these  early  schools.  2.  The 
subjects  in  which  the  medieval  universities  examined  were  those 
of  the  trivium  and  quadrivium  in  the  faculty  of  arts;  theology; 
medicine;  civil  lav/;  and  canon  law.  3. 

The  beginning  of  the  method  of  examinations,  as  we  now  un- 
derstand the  term,  was  in  the  16 th  and  17th  centuries.  At  the 
Merchant  Taylor  School  in  London  the  first  examination  was  held. 
It  was  devised  to  bring  out  active  and  initiative  powers  of  pu- 
pils even  more  than  to  test  mere  retentive  capacity.  4. 
Comenius,  it  is  recorded,  planned  university  training  for  only 
those  who  could  pass  rigid  examinations.  5. 


1.  Lang,  MODERN  METHODS  IN  WRITTEN  EXAMINATIONS,  page  135  in 

Part  11 

2.  Ibid  - 65 

3.  Ibid  - 70 

4.  Ibid  - 43 
Ibid  - 136 


5. 


Of  course  practical  examinations  were  employed  for  a long 
time  in  the  medieval  universities  in  such  a subject  as  medicine, 
but  all  others  were  probably  oral  until  1702  when  Bently  intro- 

duced  at  Trinity  College,  Cambridge,  the  written  form.  1, 



The  next  development  of  this  subject  was  to  test  ability 
to  enter  professions,  for  which  up  to  the  nineteenth  century 
preparation  through  a period  of  apprenticeship  was  prevalent.  2. 

Examinations  had  previously  been  qualifying  tests  to  as- 
certain whether  a candidate  had  reached  a definite  standard.  A 

further  extension  of  this  was  the  competitive  examination  by 

...  .... 

which  candidates  were  not  only  required  to  attain  a standard, 
but  were  arranged  in  order  of  merit.  3. 

In  1848,  Dr*  Whewell  introduced  examinations  in  the  ele- 
mentary school,  and  in  1861,  Rt.  Robert  Lowe  submitted  the  re- 
sults of  the  elementary  examinations  as  a basis  for  Government 
grants.  However,  in  1897  this  system  of  payment  by  results 
was  abolished.  4. 


1.  Ibid. 

2.  Ibid. 

3.  Ibid. 

4.  Ibid. 


39 

40 

41  and  84 
48  and  101 


«5?  • I •;  . y . *t‘  iv  . i 3 J>i  •> 

' ? j G#l*  V i ftU  ( :v*  i;  '?  *4J-  ni  ‘3; 

. . ' - ’ , ■ 

,+  • of  v/  OuOv-  • rri3  *0  rtr  Tr;(-i'.e ’/'»■:  Jxosv  ■:r; 

qju  rfo&ftir  ic'i  ferroiaselo7q  ‘le^xie  cf 

. ; . * v,  .*r  f . ? . 

. 

. 

. ■ • v ■ ' - :.••'•••  . 

„ f ' ...  r-Mfe  J Irs'r.'.J.':  O’"  \ r'K  j - r r;o-'  * -;•,;?  '.too  n:  : V 

. 

. 

J i 9X*.  T*IC  /<);  ' 10^  Sleucf  1 !■  ••■  r*XV  to  X;  ■ ‘X9  \.^J-£T»t^X9  **  '> 

* 


• * • 


* 

* 

- 

, 

*» 

* 

h&£- 

3£>  ~ 

* 

The  first  attempt  at  standardized  objective  tests  was  done 
by  the  Reverend  George  Fisher,  an  English  schoolmaster,  in 
1864,  1. 

In  America,  the  first  examination  of  historic  interest  was 
The  Boston  Examination  of  184-5.  It  was  really  a survey.  2. 

Two  young  tutors  in  mathematics  introduced  the  written  examin- 
ation at  Harvard.  That  being  so,  Harvard's  first  written  ex- 
amination  was  held  in  1857.  3. 

It  is  significant  to  note  that  the  initial  works  of  Mann, 
Fisher,  and  Rice  were  all  so  far  ahead  of  their  time  that  their 
efforts  had  little  influence  on  education  then,  but  Thorndike, 
who  was  a student  in  Columbia  University,  took  up  the  work  in- 
itiated by  those  sincere  early  educators  and  fostered  it  until 
the  other  educators  and  the  general  public  were  ready  to  recog-  j 
nize  its  benefits  and  profit  by  its  possibilities;  thus  their 
untimely  efforts  were  not  lost  to  posterity.  4. 

The  objective  type  test  has  been  advocated  since  1920,  (5) 
and  the  standardized  test  since  1905. 


1.  Encyclopaedia  Britannica  XIV  Edition. 

2.  See  page  140,  O.W.C.Caldwell  and  S. A. Curtis,  THEN  AND 
NOW  IN  EDUCATION,  1845-1923  Copy wright  1923,  by  World 
Book  Company  of  N.Y. ; also  page  135,  Lang,  MODERN 
METHODS  IN  WRITTEN  EXAMINATION.  Part  II. 

‘ 

3.  Ibid-115. 

. 

4.  Encyclopaedia  Britannica  XIV  Edition. 

5.  Part  II  page  143. 


A.  S.  Barr,  in  the  REVIEW  OF  EDUCATIONAL  RESEARCH,  supplies 
information  concerning  the  uses  of  tests  and  measurements  in 
China,  England,  France,  and  Germany.  There  is  plenty  of  evi- 
dence  to  show  that  educational  tests  are  in  process  of  develop- 
ment in  China.  The  Chinese  movement  of  the  20th  century  is  the 
result  of  American  influence. 

The  tests  in  England,  France,  and  Germany  have  also  been 

• 

stimulated  in  part  by  American  influence,  but  they  also  show  a 
point  of  view  distinctly  their  ov/n.  In  England,  statistics  is 
still  a dominant  interest.  France  is  interested  chiefly  in  in- 
telligence tests,  while  Germany  has  specialized  in  aptitude  test 
ing.  In  Europe,  educational  tests  are  used  for  the  most  part  as 
aids  in  research.  Many  of  the  foreign  studies  are  more  exten- 
sive and  thorough  than  those  in  this  country.  American  workers 
can  derive  much  benefit  by  familiarizing  themselves  with  the  me- 
thods and  point  of  view  of  their  fellow-workers  in  foreign  coun- 
tries. 1. 

Lee  and  Symonds  have  written  an  excellent  summary  of  inves- 
tigations concerning  objective  tests  reported  between  Oct.  1931 
and  Oct.  1933;  they  included  a bibliography  of  104  references. 
Holzinger  and  Seineford  have  compiled  three  annual  annotated  bib- 
liographies of  selected  references  of  the  theory  of  test  construe 
tion.  2. 


1.  Barr,  A.  S.  REVIEW  OF  EDUCATIONAL  RESEARCH  pp.  443-455 
April  1935. 


2.  Bibliography. 
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Standardized  tests,  as  well  as  teacher-made  tests  and  quizzj 
are  used  least  by  the  industrial  arts,  home  economics,  fine  arts 

i 

and  physical  education  departments.  The  English  department, 
though  not  ranking  high  in  the  other  forms  of  measurement,  ranks 
second  in  the  percentage  of  teachers  who  use  standardized  achiev 
ment  tests.  Fifty-four  percent  of  the  English  teachers  gave  one 
or  more  standardized  tests.  This  is  not  especially  surprising 
considering  that  there  are  more  than  a hundred  tests  published 
for  the  use  of  English  teachers. 

Recently  there  has  been  some  slight  tendency  for  authors  tc 
prepare  standardized  tests  to  accompany  their  own  textbooks. 
There  also  have  been  a number  of  published  courses  of  study 
which  have  included  tests  to  measure  the  material  covered.  1, 


e 


e 


1.  Testing  Practices  of  High  School  Teachers. 

U#  S.  Dept,  of  the  Interior.  Office  of  Ed.  Bulletin 


No.  9.  1936. 
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There  are  four  types  of  measurements  in  the  modern  school 
today . 

They  are : 

1.  Oral  questioning 

2.  The  written  examination 

3.  The  standard  test 

4.  The  objective  or  new-type  examination 

There  are  other  means  of  evaluating  school  results,  but  the 
four  types  mentioned  are  the  most  frequently  used. 

The  standardized  examinations  have  just  completed  the  first! 
quarter  century  of  their  existence.  From  a few  pioneer  attempts 
by  Rice,  Thorndike,  Stone,  Curtis,  and  others,  the  movement  has 
grown  until  conservative  estimates  place  the  total  number  of 
available  tests  and  scales  at  five  hundred  at  least;  there  are 
probably  considerably  more.  It  is  impossible  to  secure  even  ap- 
proximate estimates  of  the  numbers  of  standard  tests  administ- 
ered annually.  There  are  several  educational  tests  whose  sales 
have  passed  the  million  mark  annually.  In  one  or  two  cases,  two 
million  is  a more  nearly  correct  figure.  The  total  number  of 
standard  tests  sold  during  the  year  1925  was  probably  at  least 
twenty  million,  possibly  somewhat  more.  1. 


1.  Ruch,  THE  OBJECTIVE  OR  NEW -TYPE  EXAMINATION. 


. 

- 


. 

, 

, 

. 


< « ■ , , 


- 


, 

l ' 

, 

. . , 


= 


What  are  the  functions  served  by  the  examination? 

Although  a great  many  specific  functions  have  been  claimed 
for  the  written  examination  by  one  writer  or  another,  Ruch  pre- 
sented the  following : 

1.  "Motivation  of  the  learning  of  pupils. 

2.  Maintenance  of  standards  of  accomplishment. 

3.  Training  in  the  use  of  the  English  language. 

4.  Measurement  of  accomplishment."  1. 

What  is  the  criteria  of  a good  test  or  examination? 

The  criteria  for  use  in  the  construction  of  standard  and 
unstandardized  tests  naturally  differ  inconsiderably  among  ed- 
ucators. Dr.  Wilson  submitted  the  following: 

"Primary  or  major  criteria.  The  major  criteria  relate 
to  the  ends  which  should  be  served  by  testing  and  which  are  more 
fundamental  than  the  testing  itself. 

i 

1.  A test  3hould  be  in  harmony  with  and  reinforce  the 
right  curricular  principles. 

2.  A test  should  encourage,  supplement,  and  reinforce! 
prooer  methods  of  teaching. 

3.  A test  should  serve  the  true  purpose  of  an  exami- 
nation." 2. 


1.  Ruch,  THE  OBJECTIVE  OR  NEW -TYPE  EXAMINATION. 

2.  Wilson,  a.  M.,  CRITERIA  OF  A STANDARDIZED  TEST,  Educa- 
tional Review,  March,  192$. 
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"Secondary  or  minor  criteria: 

Examinations  are  a means,  not  an  end.  Standar- 
dized tests  are  likev/ise  a means,  not  an  end.  Unless  a test 
meets  the  three  primary  criteria  already  stated,  it  is  bad  and 
should  be  abandoned.  However,  it  may  meet  the  three  primary  cri 
teria  and  still  not  be  nearly  as  good  a test  as  possible.  There 
are  further  refinements  and  these  refinements  have  been  the  par- 
ticular contribution  of  the  scientific  workers  in  the  field  of 
educational  measurement ....  In  general,  the  results  of  such  re- 
finements upon  a test  are  to  make  it  more  valid,  more  accurate, 
more  reliable,  more  objective,  more  economical  to  administer, 
and  more  valuable  in  its  interpretative  results."  1. 

What  is  a good  test? 

1.  "A  good  examination  is  the  best  teaching  which  can 
be  done  at  the  time. 

2.  A good  examination  provides  for  a nevf  vie?/,  a re- 
organization, or  a worth-while  application."  2. 


1.  Wilson,  G-.  M.,  CRITERIA  OF  A STANDARDIZED  TEST 
Educational  Review,  March,  1926. 

2.  Ibid. 
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Purpose 


Examinations  were  used  in  early  times  for  the  purpose  of 
selecting  men  for  the  government  service  in  China.  1. 

During  the  middle  ages  examinations  were  employed  to  choose 
church  men,  teachers,  and  doctors.  2. 

At  the  Merchant  Taylors*  School,  in  the  sixteenth  century, 
examinations  we re  devised  to  bring  out  the  active  and  initiative 
powers  of  pupils.  3. 

The  foundation  deeds  of  endowed  schools  sometimes  contained 
a provision  for  an  examination.  The  object  of  this  seems  to  hav 
been  rather  to  ascertain  that  the  teaching  was  satisfactory  than, 
to  classify  the  students.  4. 

In  common  with  the  various  trade  guilds  of  the  time,  the 
teaching  guild  had  its  successive  stages  of  apprentice,  journey- 
man, and  master.  Promotion  from  a lower  stage  to  a higher  one 
depended  upon  passing  an  examination.  The  completion  of  the  ap- 
prentice stage  entitled  the  candidate  to  the  baccalaureate  degrete, 
and  was  determined  by  a test  of  his  ability  to  define  and  explain 
terms.  5* 


1.  See  page  35  in  Part  11. 

2.  Ibid.  - 39. 

3*  Ibid.  - 43. 

4.  Ibid.  - 100. 

5.  Ibid.  - 136. 
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In  France  the  examination  of  the  baccalaureate,  though  con- 
ducted in  part  by  the  university  examiners,  became  a school- 
leaving examination.  1. 

Defenders  of  examinations  were  of  the  opinion  that  tests 
were  necessary  in  order  to  determine  the  efficiency  of  schools 
to  which  grants  of  public  money  were  given.  2. 

In  1886  the  use  of  the  results  of  written  examinations  as 
a basis  for  the  promotion  of  pupils  was  general  in  the  graded 
schools  in  the  United  States.  However,  in  1893,  pupils  were 
promoted  on  the  estimates  or  judgment  of  teachers  in  many  cities, 
including  nearly  a score  of  the  largest  cities  in  the  country; 
and  many  other  cities  made  the  teacher’s  judgment  a considerable, 
if  not  the  chief,  element  in  the  promotion  basis.  This  testi- 
mony seemed  conclusive  that  the  non-use  of  promotion  examinations 
had  been  attended  with  a gratifying  improvement  in  the  spirit  of 
the  schools,  in  less  mechanical  and  more  rational  teaching,  and 
in  the  attainment  of  better  results;  and,  where  the  estimate 
plan  had  been  intelligently  administered,  there  wg,s  no  loss  in 
classification. 

In  1886  it  seemed  wise  to  use  examinations  for  teaching 
purposes.  3. 

1.  See  part  11  page  75. 

2.  Ibid.  - 9^. 

3.  ELEMENTS  OF  PEDAGOGY  by  Emerson  E.  White,  Am. Book  Co.N.Y. 
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White  suggests  further  that  examination  results  should  not 


be  made  alone  the  chief  basis  for  the  promotion  of  pupils."  It 
seems  unnecessary  to  add  that  it  is  not  proposed  to  dispense 
with  examinations  for  teaching  purposes;  examinations  Instituted 
for  the  one  purpose  of  testing  the  results  of  instruction  and 
study  as  a means  of  improving  them.  The  remedy  proposed  is  the 
non-use  of  the  results  of  stated  examinations  as  a basis  for  the 
promotion  of  pupils,  not  the  non-use  of  teaching  tests"  1* 

President  Eliot  of  Harvard  stated  that  "examinations  are 
much  more  than  a means  of  grading  students.  They  prepare  young 
men  to  meet  the  similar  crises  which t hey  constantly  encounter 
in  after-life,  particularly  in  the  professions,  -both  learned 
and  scientific,  -in  the  public  service,  and  in  business  adminis-J 
tration."  2. 

Using  tests  for  what  they  may  contribute  to  the  realization 
of  the  important  aims  of  education  and  the  solution  of  education- 
al problems  appears  decidedly  to  be  the  modern  tendency.  3. 


1.  White,  Emerson,  ELEMENTS  OF  PEDAGOGY,  Am. Book  Co.,  N.Y. 

2.  Eliot,  Charles,  UNIVERSITY  EXAMINATION. 

3.  Journal  of  Ed.  Research,  March,  1935. 
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Hygiene  requires  that  examinations  should  be  given  for  the  j 
sake  of  the  students,  and  not  in  behoof  of  an  institutional  stanj- 
dard.  Apart  from  examinations  at  graduation  and  the  like,  the 
chief  reason  for  formal  tests  is  to  determine  a pupil's  fitness 
for  doing  profitably  a higher  grade  of  work.  7/hen  this  can  be 
I determined  without  examination,  a formal  test  is  unnecessary,  l.i 

Survey  testing  of  educational  attainment  has  become  a large* 
and  well-established  part  of  school  surveys.  Many  have  contri- 
buted  to  this  movement,-  Harris,  Moore,  Strayer,  Ayres,  Judd, 
and  others.  The  "Survey  movement"  had  its  day:  its  methods 
continue  to  be  used. 

Achievement  testing  is  no w a regular  part  of  school  surveys. 

2- 

"Scientific  research  leads  eventually  to  practical  uses, 
and  practical  research  becomes  a complement  or  a consequent  of 
its  more  respected  antecedent."  3. 


1.  See  page  60  in  Part  11. 

2.  Ibid.  - 111. 

3.  Strang,  Ruth,  TEACHERS  COLLEG-E  RECORD  Vol.  xxxv  No.  2, 
Nov.  1933,  Columbia  University,  pp.  120-133* 
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Form 

First  tests  were  oral.  1.  Socrates  used  the  question  and 
answer.  2.  The  Church  practised  likewise  and  still  does, with 
explanations  to  convey  the  true  understanding  of  the  lessons  to 
he  learned.  3. 

The  early  universities  used  different  forms:  those  of  dis- 
putations, determinations,  defense  of  theses,  and  public  lec- 
tures. 4. 

A disputation  is  an  act  of  disputing,  controversy;  debate; 
a formal  exercise  in  which  parties  reason  in  opposition  to  each 
other.  In  college  it  is  an  exercise  in  which  one  person  argues 
a question. 

Determination  is  a discussion:  the  resolving  of  a question 
by  argument  or  reasoning.  In  English  universities,  a disputatioh 
was  formerly  held  by  those  just  made  bachelors  of  arts  as  a con-j 
dition  of  proceeding  toward  the  master'  s degree. 

Defense  of  theses  and  public  lectures  were  other  similar 
forms . 

At  Oxford,  disputations  were  apparently  the  only  test  appljj|e 
in  its  early  history.  5* 

The  doctoral  examination  at  Bologna,  in  the  13th  and  14th 
centuries,  consisted  of  two  parts  - a private  examination  which 
was  a real  test,  and  a public  one  of  ceremonial  character  (con- 
ventur) . 6. 


1.  See  page  39  Part  11.  4.  Ibid.  - 65 

2.  Ibid.  - 37  5.  Ibid.  - 70 

3.  Ibid.  -"History  of  Education"  6.  Ibid.  - 64 

Patrick  J.  McCormick,  Cath.  Ed. 

Press,  Wash.  D.  C.  1916 
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From  notices  of  contests  between  the  universities  and  the 

medical  corporations  in  London,  one  may  gather  that  students  had 
to  pass  an  examination,  after  going  through  their  apprenticeship, 
before  being  allowed  to  practise.  But  an  examination  was  never 
the  sole  test;  it  was  always  attached  to  a prescribed  course  of 

!; 

study  and  service.  1. 

In  medicine,  the  clinical  examination  of  a patient  was  a 
test  carried  out  under  conditions  more  nearly  approaching  those 
of  actual  work  than  any  other;  and  distinction  in  medical  exam- 
inations  was  probably  more  often  followed  by  fame  in  after  life 
than  was  the  case  of  other  examinations.  2. 

At  the  French  examinations  for  the  prix  de  Rome,  the  can- 
didates were  required  to  execute  a painting  in  a given  number  of 
days,  under  strict  supervision  ( en  loge) . 3. 


1.  See  page  39  Part  11. 

- 83. 

- 83. 
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2.  Ibid. 

3.  Ibid. 


The  thesis  is  a long  essay,  "based  on  original  research  work 
and  offered  by  a candidate  for  an  advanced  degree. 

At  Cambridge  University,  England,  the  examination  (Tripos) 
was  instituted  in  the  first  half  of  the  18th  century  for  honors 
in  mathematical  science.  Since  1824,  the  final  honors  examina- 
tion in  classics  was  held,  to  which,  until  1850,  only  those  who 
had  previously  obtained  honors  in  mathematics  were  admitted. 

The  word  tripos  was  first  applied  to  the  three-legged  stoo  . 
on  which  sat  a bachelor  of  abts  appointed  to  dispute  humorously 
with  candidates  for  degrees;  then  to  the  man  himself;  then,  un- 
til 1894,  to  a set  of  versed  (tripos  verses)  composed  by  him 
and  published  at  commencement;  then  to  the  list  of  successful 
candidates  for  honors,  printed  on  the  back  of  the  paper  contain- 
ing the  verses;  then  to  the  examinations. 

The  so-called  new-type  of  examination  has  a great  many 
questions  requiring  short  answers  in  contrast  to  the  old  essay- 
type  requiring  long  answers  to  a short  number  of  questions. 

The  standardized  test  has  the  possibility  of  more  accurate 
measuring.  There  are  many  good  standardized  tests.  On  the  othe:» 
hand,  there  are  so  many  poor  standardised  tests,  that  extreme 
care  is  needed  to  prevent  interference  with  good  instruction, 
and  the  setting  up  of  false  standards. 

Units  worked  out  in  school  and  in  conferences  with  the 
teacher  are  the  very  latest  testing  procedures  (1938),  Thus, 
school  life  is  becoming  more  nearly  like  real  life  situations. 
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As  early  as  1925,  the  National  Educational  Association 


found  that  in  all  cities  of  the  United  States  of  25,00  or  more 
inhabitants  some  recorded  form  of  rating  was  in  use.  1. 

In  the  college  world  the  Honors  System  as  used  at  Swarth- 

:more,  and  in  part  in  many  other  colleges,  frees  an  abler  student 

| 

in  junior  and  senior  years  from  required  attendance  at  lectures 

i 

land  recitations  -the  work  done  being  individual,  with  frequent 
conferences  and  final  comprehensive  examinations.  2. 

Granting  the  need  of  measuring  and  recording  in  some  def- 
inite  way  the  progress  of  pupils  in  academic  skills  and  achieve- 

l 

ments,  it  is  not  necessary  to  use  the  recitation  as  a means  for 

^securing  marks.  In  progressive  schools,  the  formal  recitation 

I 

is  discarded,  the  academic  standing  of  the  children,  when  desired, 

I 

being  arrived  at  by  other  means.  In  place  of  the  recitation  are 

i 

lactivities,  projects,  research,  and  reports.  Or,  if  text-book 

j| 

work  is  assigned,  the  discussion  of  the  lesson  is  in  the  form  of 
a conference,  in  which  the  matter  of  marks  is  removed  entirely 

!| 

from  the  consciousness  of  the  children.  3. 

|j 

At  Yale  a new  system  of  general  examinations,  in  which  stu- 
jdents  will  take  tests  in  their  major  field,  was  announced  in  1936. 


4. 


L.  Flinn,  Vee  -A  TEACHER  RA.TING  BY  PUPILS.  Educational 
Method  Vol.Xl  No.  5.  Feb. 1932  pp.  290-295. 

2.  Cobb,  Stanwood:  THE  NEW  LEAVEN  page  206. 

j 

3.  Ibid.  - 207. 

4.  Pathfinder,  Pub,  by  the  Pathfinder  Pub.  Co,,  2414-16-18 
Douglas  St.,  Washington,  D.  C.  Oct.  10,  1936,  No.  2232. 
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Merita 

A test  is  an  aid.  to  teaching.  Dr.  Guy  Wilson,  Professor 
of  Education  in  Boston  University,  stated  in  one  of  his  books 
that  a test  should  be  "the  best  teaching  at  the  time."  (l) 

This  is  true  at  all  levels,  but  first  let  us  consider  the  prim- 
ary grades.  Pennell  and  Cusack  have  stated  that  the  use  of  in- 
formal and  standard  tests  should  help  the  teacher  in  knowing 
the  needs  of  her  children  and  in  fitting  her  work  to  those  needs 
The  test  should  help  the  child  by  showing  him  his  power  in  read- 
ing, his  help  along  certain  lines,  and  the  improvement  that  he 
makes.  It  is  a great  incentive  to  a child  to  see,  in  class 
graphs  or  in  individual  graphs  which  the  teacher  makes  from  the 
results  of  the  tests,  where  he  is  in  relation  to  the  rest  of 
the  class,  as  well  as  the  improvement  that  he  is  making.  (2) 

In  like  manner  it  helps  a school  system  to  estimate  itself 
in  relation  to  another  school  system. 

1.  Wilson  and  Hoke,  HOW  TO  MEASURE  Last  Chapter 

2.  Cubberley,  Ellwood  P. 

Education  in  the  United  States  Pg.  446-449 
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The  result  of  a standardized  test  is  an  impartial  way  of 
showing  parents  just  where  their  child  stands  in  relation  to 
others  in  the  group,  and  likewise  it  is  an  effective  device 
whereby  one  school  can  learn  its  particular  place  nationally. 

The  standardized  test  is  an  aid  to  the  type  of  child  or 
student  who  would  be  underestimated  except  for  such  a check. (1) 

It  also  helos  the  teacher  who  otherwise  might  be  insuffi- 
cient. (2) 

Examinations  also  compel  indifferent  and  careless  students 
to  do  some  work  and  are  a valuable  training  for  later  life. (3) 
Moreover,  they  oblige  a person  to  be  able  to  produce  his  know- 
ledge. (4) 


1.  Hildreth,  G-ertrude 

Mental  Ability  Measured  by  Verbal  and  non-verbal  tests 
Teachers  College  Record,  Nov.  1932.  pp. 134-144 

1 

2.  E.  White,  ELEMENT  OF  PEDAGOGY  Chapter  on  Tests 

3.  Ibid  page  115 
4. Ibid  102 
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Abuses 

Books  on  Education  in  years  past  were  ever  quoting  the 
abuses  and  evils  of  examinations. 

Regarding  the  money  grants  to  schools  as  a result  of  the 
examinations,  the  majority  held  that  so  long  as  money  value  was 
attached  to  success  in  individual  tests  the  children's  health 
, and  welfare  was  endangered.  It  was,  however,  in  the  field  of 

secondary  education  that  the  tyranny  of  examinations  were  felt. 

(1) 

"The  use  of  written  examinations",  says  White,  "have  been 
| the  prolific  source  of  bitter  jealousies  and  rivalries  between 
, schools  and  teachers,  and  they  have  otherwise  been  attended  by 
serious  evils.  They  have  perverted  the  best  efforts  of  teachers 
and  narrowed  and  grooved  their  instruction;  they  have  occasioned 
and  made  wellnigh  imperative  the  use  of  mechanical  and  rote 
methods  of  teaching;  they  have  occasioned  cramming  and  the  most 
vicious  habits  of  study;  they  have  caused  much  of  the  overpres- 
sure charged  upon  the  schools,  some  of  which  is  real;  they  have 
tempted  both  teachers  and  pupils  to  dishonesty  and,  last  but  no 4 
least,  they  have  permitted  a mechanical  method  of  school  super- 
vision." (2) 

These  evils  have  not  disappeared  even  with  the  advent  of 
the  standardized  

1.  Part  11,  page  49 

2. E.  White,  ELEMENT  O1^  P^DAGOG-Y  Chapter  on  Tests 
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There  are  many  factors  that  enter  into  the  testing  situa- 
tion: the  individual’s  physical  an d mental  health  at  the  time 

of  the  examination;  the  weather,  and  the  kind  of  test. 

Research  has  shown  that  the  use  of  only  a few  questions 
means  that  a test  is  so  unreliable  as  to  be  practically  worth- 
less. It  is  commonly  accepted  b^A  writers  on  measurement  that 
an  objective  test  should  have  a hundred  items  to  have  sufficient 
reliability  to  be  valuable  as  a measuring  instrument.  (l) 

Research  reveals  that  children  prefer  the  so-called  new- 
type  examination  to  the  old  essay-form  of  test,  (2) 

A good  standardized  test  In  the  hands  of  an  inexperienced 
teacher  may  be’  a regretable  abuse. 

Often  a test  does  not  coincide  with  the  subject  matter 
taught . ( 3 ) 


1.  Testing  practices  of  High  School  Teachers,  U.S.  Dept, 
of  Inter.,  Office  of  Education,  Bulletin  No.  9,  1936 

2.  Paterson,  PREPARATION  AND  USE  OR  NEO-TYPE  EXAMINATIONS 

3.  Thite,  E. , ELEMENTS  OF  PEDAGOGY  Chapter  on  Tests 
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The  studies  of  Starch  and  Elliot  have  become  a classic  re- 
ference on  the  variation  of  teachers’  marks  for  essay  examina- 
tion papers.  The  teachers  gave  one  paper  grades  ranging  from 
64  to  98  percent,  etc. 

Tests  tend  to  destroy  spontaneity.  Nine  young  people  out 
of  ten  may  quite  rightly  be  made  to  move  in  a good  "regulation 
groove"  but  the  tenth  would  be  better  for  having  room  to  expat- 
iate. (2) 

Those  which  deal  with  general  education  should  not  be  con- 
tinued beyond  the  age  of  22.  Professional  examinations  or  ex- 
aminations in  the  highest  parts  of  science,  intended  for  those 
who  mean  to  give  their  lives  to  study,  must  come  later,  but 
should  be  as  little  competitive  as  possible.  (4) 


1.  See  Index,  Part  II  page  201 

2.  Part  II,  page  103 

3.  Ibid  103 

4. 


Ibid  103 
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As  early  as  1908,  the  distinguished  Charles  Eliot  sighted 
the  fact  that  "A  generation  is  growing  up  in  many  parts  of  the 
country  which  has  successfully  avoided  examinations,  having  ac- 
quired the  belief  that  examinations  are  an  evil,  instead  of  a 
profitable  means  of  sound  training. " (1) 

A dissertation  written  at  leisure  is  an  excellent  means  of 
judging  qualifications,  and  may  be  used  for  those  who  are  past 
the  proper  age  for  examinations.  (2) 


1.  Eliot,  Charles.  UNIVERSITY  EXAMINATIONS 

2.  Part  II,  page  104 


"if  education  were  indeed  an  industry  dealing  with  raw 
materials  of  fixed  or  measurable  quality,  subjecting  its  mater- 
ials to  routine  processes,  these  tools  of  measurement  would 
probably  be  acceptable  and  adequate  on  the  whole.  But  education 
is  not  an  industry.  It  is  a highly  complicated  process.  The 
"stuff"  with  which  it  deals  is  precious  human  material,  infin- 
itely diverse  and  complex.  Human  personality  and  growth  and 
character  cannot  be  expressed  by  an  equation  or  a symbol. 

Sooner  or  later  all  of  this  will  become  a matter  of  common 
knowledge  and  understanding  and  then  perhaps  someone  will  get 
out  an  injunction  restraining  us  from  carrying  on  the  pretense 
that  we  can  evaluate  and  rate  pupils  by  mathematical  formulae 
or  alphabetical  symbols."  (l) 

This  criticism  is  aimed  at  all  examinations  particularly 
the  standardized  test. 


1.  Lund,  John,  UNDERSTANDING-  THE  CHILD.  April,  1934, pg. 23 
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CHRONOLOGY 


2200  3.C.  Examination  for  Civil  Service  in  °hina. 

468-399  B.C.  The  Socratic  method  of  question  and  answer. 

3rd  century  tests  of  qualification  at  Alexandria. 

3rd  and  4th  centuries  fullest  development  of  the  Catechemenate. 
12th  century  Beginning  of  universities  of  the  Middle  Ages. 

1562  1st  examination.  Merchant  Taylor  School,  London. 

1592-1671  Founding  of  university  training  after  examination  by 
Comenius. 
l66l  Test  Act. 

1693  Corporation  Act. 

1702  Introduction  of  written  examination  at  Trinity  College. 

1747  First  honors  examination-Matheraatical  Tripos. 

1802  Examination  for  B.A.  degree. 

1824  Cambridge  founded  the  Classical  Tripos. 

1836  Teaching  and  examining  functions  of  London  University, 
dissociated . 

1845  Boston  Examination  - A survey. 

1848  Introduction  of  examinations  in  elementary  schools  by  Dr. 
’Thewell . 

1851  Moral  and  Natural  Science  Tripos, 

1853  Beginning  of  decline  of  emphasis  upon  technical  grammar. 

1854  Competitive  Examinations  in  England  for  public  posts. 

1357  Harvard's  first  examination. 

1858  School  leaving  examinations. 

1864  First  attempt  at  standardized  objective  tests  by  Fisher. 

1871  Accrediting  system. 

1886  Use  of  results  of  examinations  as  basis  for  promotion. 

1890  Abolition  of  individual  examinations. ''examination  by  sample' 
introduced, 

1893  Promotion  of  pupils  on  estimates  of  teachers  in  some  places, 
1897  Abolishment  of  system  of  payment  by  results. 

1905  1st  standardized  test, 

1908  Beginning  of  general  belief  to  avoid  examinations. 

1912  Variation  in  marking  of  teachers  proved  by  experiment. 

1920  Objective  type  of  examination  advocated. 

1925  Beginning  of  achievement  testing  on  national  scale. 

1928  Superior  student  freed  of  recitation  advocated  by  Stanwood 
Cobb. 

1933  Scientific  research  more  in  evidence. 


+ 
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SUMMARY 


These  are  records  of  examinations  in  China,  2200  years  be- 
fore  Christ,  and  a variety  of  tests  are  noted  in  Greece  at  least 
i»  as  early  as  500B.C. 

The  Holv  Bible  discloses  several  choice  references  to  re- 
connaissance and  to  introspection.  Socrates  is  given  recogni- 
tion, and  deservedly  so,  in  many  educational  books  because  of 

!i 

ilhis  unique  manner  of  questioning.  The  Catechetical  method-that 


32 


of  question  and  answer-which  was  markedly  prevalent  in  the  3rd 


and  4th  centuries .has  continued  through  the  ages. 

The  present  examinations  in  universities  are  naturally  an 
outgrowth  of  the  procedure  in  the  medieval  universities. 

Presumably  all  examinations  were  oral  until  the  18th  cen- 
tury when  the  written  mode  came  into  practice. 

About  the  middle  of  the  18th  century  the  examinations  in- 


;;vaded  the  elementary  schools. 

The  initial  ourooses  of  examinations  were  for  the  selecting 

!j 

of  suitable  applicants  for  service  in  the  government  and  pro- 
fessions.  The  schools  examined  for  the  baccalaureate,  entrance 
I' to  college,  grades,  and  money  grants. 

Up  to  and  including  the  first  part  of  the  20th  century  very 
little  was  written  in  favor  of  the  examinations;  on  the  contrary 
they  were  subjected  to  much  adverse  criticism.  Of  what  kind 
were  those  objectionable  tests?  They  were  imposed  by  authorities 
and  usually  unscientif icatly  made,  administered,  and  corrected. 
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The  time  was,  quite  a number  of  years  past  now,  when  the 
gentleman  who  was  the  best  arguer,  in  other  Y/ords,  the  one  whose 
attractive  personality  and  clever  ability  in  the  use  of  persua- 
sive oratory  was  the  one  whose  golden  oppinions  were  accepted  as 
unimpeachable.  Fortunately  this  regrettable  attitude  is  non- 
existant  among  the  majority  of  thinking  people  today* 

The  wealth  of  scientific  induction  available  at  the  present 
time  is,  and  should  be,  the  only  sound  estimate  which  should 
guide  our  thoughts  and  alter  our  decisions. 

'’Scientific  thinking  is  better  thinking",  stated  Victor  Noll, 

Research  tells  us  that  a test  must  have  at  least  100  items 
to  be  valid.  Research  proves  that  children  and  students  prefer 
the  so-called  new  type  of  examination  to  the  oral  essay  form  of 
test. 

Research  has  revealed  that  teachers'  marks  vary  so  that 
practically  no  faith  can  be  placed  in  them.  The  standardized 
test  would  appear  to  meet  the  need  in  tnis  field. 

The  Journal  of  Educational  Research  of  March  1935  states 
that  "The  general  opinion  seems  to  be  that  the  influence  of  meas- 
urement upon  instruction  may  be  either  beneficia.1  or  harmful  de- 
pending primarily  upon  the  nature  and  quality  of  the  measuring 
instruments  used." 

May  we,  who  are  intrusted  with  a portion  of  this  world’s 
knowledge,  and  are  chosen  Instruments  for  the  guiding  of  youth, 
use  tests  wisely  - as  an  aid  to  teaching,  to  find  just  where 
our  opportunities  for  service  are,  and  not  abuse  this  sacred 
trust  which,  for  a time,  is  ours. 
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PART  II 


(Being  an  assembly  of  quotations  on  exam- 
inations, throughout  the  history  of  education.) 
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System  of  Examinations  in  China  from  2200  B.C.-  1906  A .D . 

The  following  selection  is  copied  verbatim  from  Encyclopaedia 
Britannica  11  Edition  page  184. 

The  bureaucratic  element  was  a vital  feature  in  the  govern- 
ment of  China,  the  holding  of  office  being  almost  the  only  road 
to  distinction.  The  ranks  of  the  civil  service  were  recruited 
by  means  of  examinations.  Up  to  the  beginning  of  1906  the  sub- 
jects in  which  candidates  were  examined  were  purely  Chinese  and 
literary  with  a smattering  of  history.  The  old  system  was  close- 
ly identified  with  the  life  of  China. 

As  a general  rule  students  preparing  for  the  public  exam- 
ination read  with  private  tutors. There  were  neither  high  schools 
nor  universities  where  a regular  training  could  be  obtained.  In  . 
most  of  the  provincial  capitals,  and  in  some  other  places,  there 
were  institutions  termed  colleges , supported  to  some  extent  from 
public  funds,  where  advanced  students  could  prosecute  their 
studies;  but  before  the  movement  initiated  by  the  viceroy  Cliang 
Chik-tung  after  the  China- Japan  War  of  1894,  they  hardly  counted 
as  factors  in  the  national  education.  The  private  tutors,  on 
the  other  hand  were  plentiful  and  cheap.  After  a series  of  pre- 
liminary trials  the  student  obtained  his  first  qualification  by 
examination  held  before  the  literary  chancellor  in  the  prefec- 
ture to  which  he  belonged.  This  was  termed  the  Siuts 1 ai . or 
licentiate's  degree,  and  was  merely  a qualification  to  enter  for 
the  higher  examinations.  The  number  of  licentiate  degrees  to  be 
given  was,  however,  strictly  limited;  those  who  failed  to  get 
in  were  set  back  to  try  again,  which  they  might  do  as  often  as 


they  pleased.  There  was  no  limit  of  age.  Those  selected  next 
proceeded  to  the  great  examination  (termed  Chujen  or  provincial 
graduate)  held  at  the  capital  of  each  province,  once  in  three 
years  before  examiners  sent  from  Peking  for  the  purpose.  Here 
again  the  number  who  passed  was  strictly  limited.  Out  of 

10.000  or  12,000  competitors  only  some  300  or  350  could  obtain 
degrees.  The  others  as  before  must  go  back  and  try  again.  The 
third  and  final  examination  took  place  at  Peking  and  was  open 
to  provincial  graduates  from  all  parts  of  the  empire.  Out  of 

6.000  competitors  entering  for  this  final  test,  which  was  held 
triennially,  some  325  to  350  succeeded  in  obtaining  the  degree 
of  Chin  shin,  or  metropolitan  graduate.  These  were  the  finally 
selected  men  who  became  the  officials  of  the  empire. 


Socrates 

The  following  selection  is  copied  verbatim  from  Outlines  of 
Eu  ropean  History  by  Robinson  and  Breasted  G-inn  and  Co.  Boston 
191^  page  205 

Socrates  was  accustomed  to  stand  about  the  market  place, 
the  street  corners,  and  the  public  baths  all  day  long,  insisting 
on  engaging  in  conversation  every  citizen  he  met,  and  asking  a 
great  many  questions  which  left  the  average  citizen  in  a very 
confused  state  of  mind.  He  seemed  to  call  in  question  every- 
thing which  the  citizen  had  formerly  regarded  as  settled.  Yet 
this  familiar  and  homely  figure  of  the  stone  mason's  son  was  the 
personification  of  the  best  and  highest  in  G-reek  genius.  With- 
out desire  for  office  or  a political  career,  Socrates'  supreme 
interest  nevertheless  was  the  State.  He  believed  that  the  State 
made  up  as  it  was  of  citizens,  could  be  purified  and  saved  only 
by  the  improvement  of  the  individual  citizen  through  the  educa- 
tion of  his  mind  to  recognize  virtue  and  right.  He  taught  that 
by  keen  questioning  and  discussion  it  is  possible  to  reject 
error  and  perceive  these  realities.  The  simple  but  powerful  per 
sonality  of  this  greatest  of  Greek  teachers  in  the  streets  of 
Athens  often  opened  to  him  the  houses  of  the  rich  and  noble. 

They  summoned  Socrates  to  trial  for  corrupting  the  youth. 

He  might  easily  have  left  Athens  when  the  complaint  was  lodged 
against  him.  Nevertheless  he  appeared  for  trial,  made  a power- 
ful and  dignified  defense  and,  when  the  court  voted  the  death 
penalty,  passed  his  last  days  in  tranquil  conversation  with  his 
friends  and  pupils,  in  whose  presence  he  then  quietly  drank  the 


fatal  hemlock  (399  B.C.)  Thus  the  Athenian  democracy,  which  had 
so  fatally  mismanaged  the  affairs  of  the  nation  in  war,  brought 
u pon  itself  much  greater  reproach  in  condemning  the  death,  even 
though  in  accordance  with  law,  the  greatest  and  ourest  soul 

I 

among  its  citizens. 

The  undisturbed  serenity  of  Socrates  in  his  last  hours,  as 

I 

pictured  to  us  in  Plato’s  beautiful  account  of  the  scene,  pro- 

i| 

f oundly  affected  the  whole  Greek  world,  and  still  forms  one  of 
the  most  precious  oossessions  of  humanity.  But  the  glorified 
figure  of  Socrates,  as  he  appears  in  the  writings  of  his  pupils, 
was  to  prove  more  powerful  even  than  the  living  teacher. 

S 
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The  following  portion  is  copied  verbatim  from  Encyclopedia  of 
Education  edited  by  PAUL  MONROE,  Ph.D. 

Examinations.  - A term  used  to  denote  the  method  of  testing 
educational  progress,  measured  either  by  amount  of  knowledge  ac- 
quired or  by  general  intellectual  capacity  or  ability.  Such  a 
method  has  been  applied  in  all  grades  of  education  in  one  form 
or  another.  The  earliest  type  of  examination  which  prevailed 
was  oral,  either  in  the  form  of  question  and  answer  (cf.  the 
textbook  of  Aelfric  (Q.v.),  which  would  lend  itself  to  such  a 

II 

!j method)  or  of  disputations  (q.v.).  Disputation,  determination, 
defense  of  a thesis,  or  the  delivery  of  a public  lecture,  pro- 
vided other  requirements  such  as  payment  of  fees,  residence, 
and  attendance  at  lectures  were  satisfied,  are  forms  which  exam- 
inations took  at  the  medieval  universities  (q.v.);  (for  details 
and  differences  at  various  universities,  see  also  Degrees).  The 
written  examination  wns  unknown  at  the  universities  probably 
until  1702,  when  it  was  introduced  by  Bentley  at  Trinity  College 
Cambridge.  Practical  examinations  had  been  employed  for  a long 
time  in  the  medieval  universities  in  such  a subject  as  medicine. 
But  the  examination  in  its  modern  form  is  a development  of  the 
eighteenth  century.  The  first  honors  examination,  the  earliest 

examination  in  the  modern  sense,  was  the  Mathematical  Tripos, 

I! 

founded  in  17^7.  The  qualification  for  a degree  was  in  fact 
merely  four  years*  residence.  Those  who  worked  did  so  at  their 


pleasure;  for  those  who  would  work  there  were,  even  in  the  worst 


times,  adequate  lectures.  The  Tripos  introduced  a new  order  of 
i things,  but  until  1797  the  proctors  added  any  names  they  liked 
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to  the  list.  In  1772  the  Master  of  St.  John's  College,  Cambridge, 
established  examinations  in  his  college  (Graham  Balfour,  Educa- 

■ 

tional  Systems).  The  lead  was  taken  up  by  Oxford  in  the  famous 

r 

"Oriel"  revival.  Before  the  end  of  the  century  examinations 

were  introduced  into  Christ  Church  by  Cyril  Jackson,  and  in  1795 

Oriel  College  began  to  elect  to  its  fellowship  from  outside  sole- 

|ly  on  the  results  of  its  own  examinations . Oxford  now  progressed 
'll 

more  rapidly  than  Cambridge.  In  1802  a genuine  examination  for 

'the  B.A.  degree  was  begun  and  a small  honors  list  with  the  name! 

1 

in  the  order  of  merit  was  published.  Between  1802  and  1870  there 
jwas  an  examination  for  the  M.A.  degree,  but  this  never  became 
effective,  and  there  is  not  to  this  day  any  examination  for  the 

!| 

master's  degree  at  Oxford  or  Cambridge.  "in  1829  the  Master  and 
[Fellows  of  Balllol  began  to  elect  scholars  after  examination.... 
The  most  brilliant  success  attended  these  reforms,  and  encouraged 
similar  measures  elsewhere"  (Balfour).  Meantime  in  1824  Cambridge 
had  founded  the  Classical  Trioos,  though  until  1850  it  was  only 
open  to  those  who  had  passed  in  the  Mathematical  Tripos.  The 
'Moral  Science  Trioos  and  the  Natural  Science  Tripos  followed  in 
;1851.  In  1850  Oxford  reorganized  her  examinations  "and  intro- 
duced Moderations  as  a test  of  pure  scholarship  in  the  middle 
of  the  University  course."  From  this  time  forward  new  schools 
and  triposes  were  created  in  rapid  succession  at  Oxford  and  Cam- 
bridge. 

A second  development  of  examinations  was  to  test  ability 
to  enter  the  professions,  for  which  up  to  the  nineteenth  century 
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preparation  through  a period  of  apprenticeship  had  prevailed. 
While  many  of  the  old  professional  societies  have  remained  un- 
changed, the  method  of  admission  has  been  changed  to  an  examina- 
tion basis.  For  details  see  articles  on  ACCOUNTANCY  EDUCATION; 
LAV/ , EDUCATION  IN;  MEDICAL  AND  SURGICAL  EDUCATION;  MINISTRY, 
EDUCATION  OF;  PHARMACEUTICAL  EDUCATION;  TEACHERS,  TRAINING-  OF; 
Also  treated  under  articles  on  the  separate  national  systems, 
e .g.  FRANCE,  EDUCATION  IN;  GERMANY,  EDUCATION  IN,  etc. 

Examinations  mentioned  up  to  this  point  have  been  qualify- 
ing tests  to  ascertain  whether  a candidate  has  reached  a defin- 
ite standard.  A further  extension  of  this  is  the  competitive 
examination  by  which  candidates  are  not  only  required  to  attain 
a standard,  but  are  arranged  in  order  of  merit,  on  the  basis  of 
which  rewards,  prizes,  scholarships,  or  appointments  are  awarded 
The  most  common  use  of  this  type  of  examination  is  to  fill  pos- 
itions in  government  or  municipal  service.  Civil  service  exam- 
inations, however,  have  been  established  comparatively  within 
Irecent  years  in  most  countries.  (See  further  PUBLIC  SERVICE, 
EDUCATION  FOR. ) The  competitive  system  is  also  used  in  most 
countries  to  secure  places  in  the  government  institutions  which 
prepare  for  the  respective  armies  and  navies.  (See  MILITARY 
EDUCATION;  NAVAL  EDUCATION. ) Scholarships  (q.v.),  exhibitions 
(q.v.),  fellowships,  and  other  academic  prizes  are  also  awarded 
some  form  of  competition. 

But  it  has  always  been  in  connection  with  the  work  of  the 
3chool  that  examinations  have  been  most  frequently  employed. 

I 


Here  they  may  be  used  periodically  as  part  of  the  class-room 


routine  to  test  the  amount  of  knowledge  retained  by  the  pupil 
in  a certain  field  (see  REVIEW  EXAMINATIONS),  or  at  stated  inter 

II 

vals  to  test  the  ability  of  pupils  to  proceed  to  more  advanced 
work  (see  GRADING-  AND  PROMOTION).  In  both  cases,  however,  the 
•work  of  examining  is  entrusted  in  most  instances  to  the  teacher 
who  has  charge  of  the  class,  or  else  is  conducted  by  the  prin- 
cipal of  the  school,  when  the  examination  is  as  much  a test  of 
the  teacher  as  of  the  pupils.  Examinations  conducted  by  extern- 

i . 

al  bodies  have  been  employed  for  various  purposes,  (1)  by  state 

I 

authorities  to  test  the  quality  of  w ork  done  by  schools  as  a 
'basis  for  the  payment  of  grants.  This  pernicious  system  prevail 
i;  ed  in  English  elementary  education  for  many  years,  and  is  still 
the  basis  of  payment  in  Ireland  for  secondary  education.  (See 
APPORTIONMENT  OE  FUNDS);  (2)  by  state  or  other  authorities,  e.g. 
universities,  professional  associations,  etc.,  as  a test  of  the 
ability  of  pupils  who  are  leaving  the  secondary  school,  to  enter 
on  higher  studies  or  merely  as  a test  of  the  knowledge  already 
ij  acquired.  Under  this  tvne  of  examinations  (q.v.).,  school  leav- 
; ing  examinations,  as  for  example  Abiturientenprufung(q.v. , and 
GERMANY,  EDUCATION  IN),  and  the  baccalaureate  (see  FRANCE,  EDUCA 
TTON  IN),  Below  a statement  is  given  of  the  different  examining 
bodies  in  England.  In  the  United  States  there  is  a tendency  at 
: present  to  supersede  such  entrance  examinations  by  a system  of 
accrediting  (q.v.),  first  introduced  by  the  University  of  Mich- 
igan in  1871.  (See  COLLEGE  ENTRANCE  BOARDS;  COLLEGE  REQUIREMENT^ 
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I FOR  ADMISSION.) 

In  Germany  and  America  the  tendency  has  been  to  limit  the 
number  of  examinations  so  far  as  possible,  and  by  building  up 
a strong  teaching  profession  and  system  of  inspection  to  accept 
the  decision  of  the  teacher  on  the  question  whether  pupils  have 
attained  required  standards  or  not.  In  France  every  step  in  the 
educational  progress  is  marked  by  some  form  of  state  examination. 
In  England  a system  of  inspection  and  better  trained  teachers 
has  taken  the  place  of  examinations  in  elementary  schools.  But 
in  secondary  education  a multiplicity  of  examining  bodies  still 
remains,  and  since  England  is  typical  of  an  extensive  system  of 
examinations,  this  is  described  below  in  some  detail, 
i!  English  System  of  School  Examinations.- 


' 

(» 

H 


The  beginning  of  the  method  of  examination,  as  we  now 

understand  the  term,  was  in  the  sixteenth  and  seventeenth  cen- 

turies,  and  is  most  clearly  to  be  traced  in  the  records  of  the 

Merchant  Taylors*  School,  London.  This  school  was  founded  in 

156l,  and  in  1562  the  first  examination  was  held.  It  was  a 

"solemn  visitation"  of  the  diocesan.  Bishop  Grindal  and  other 

learned  men  came  to  the  school  to  examine  "first  the  ushers  and 

afterwards  the  forms."  The  ushers  were  questioned  each  as  to 

his  learning  and  his  manner  of  teaching.  Then  the  boys  were 

questioned,  form  by  form.  The  head  master  was  Richard  Mulcastey* 

. 

iq.v.j,  and  the  reoort  of  the  examiners  was  commendatory  on  the 
whole,  the  only  reserve  being  that  the  staff,  being  northern 
men  born,  had  not  taught  the  children  to  speak  distinctly  but 
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that  some  of  the  boys  showed  attainments  equal  to  those  of  any 
school  in  the  realm,  '’which  gratifying  intelligence  was  quickly 
conveyed  to  rulcaster,  then  lying  sick,  and  was  received  by  him 
with  cheerfulness  and  gratitude."  In  1564  G-rindal  again  appear- 
ed, accompanied  by  Dean  Nowell  and  other  learned  men.  A boy 
named  King  gave  before  them  a pithy  and  eloquent  oration.  Other 
boys  presented  verses,  and  then  began  the  oppositions  of  the 
chief  four  forms  and  an  examination  of  the  three  ushers.  The 
proceedings  lasted  from  eight  in  the  morning  till  five  in  the 
afternoon,  with  an  interval  for  "a  repast.”  These  visitations 
or  examinations  were  made  usually  once  a year.  In  1572  there 
appeared  the  Bishop  of  Winchester  with  Dean  Nowell  and  again 
"other  learned  men,"  and  the  examination  was  more  searching  and  I 
comprehensive  than  hitherto.  Before  a considerable  gathering 
of  "venerable"  men  "the  head  scholars  of  the  school  presented 
themselves  for  examinations;  and  after  one  had  briefly  enumer- 
ated the  several  books  they  were  learning  in  Latin,  Greek,  and 
Hebrew,  Nowell  began  the  examination  by  directing  the  lowest  of 
that  form  to  declare  the  sense  and  construction  of  a particular 
ode  of  Horace,  which  from  one  to  another  he  prosecuted  through 
the  whole  number,  until  the  captain,  requiring  diversity  of 
phrases  and  variety  of  words  and  finally  omitting  nothing  which 
might  seem  needful  for  the  trial  of  their  learning  in  the  Latin 
tongue.  After  him  Watts  (Archbishop  of  Middlesex)  examined  the 
same  boys  in  Homer  as  to  their  skill  in  Greek,  which  uas  his 
favorite  language,  and  Horne  tried  them  in  the  Hebrew  Psalter. 
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In  all  which  exercises,  they  were  well  allowed.  " Dean  G-oodraan 
(founder  of  the  Ruthven  Free  School,  1595)  then  examined  the 
next  form  in  Cicero* s Tusculan  Disputations.  It  was  customary 
to  elect,  from  the  knowledge  shown  by  the  scholars  on  these 
occasions,  scholars  for  St.  John*s  College,  Oxford.  In  1586, 
Mulcaster  resigned  the  headmastership,  but  in  1602  he  again 
appeared  at  Marchant  Taylor's  School  but,  as  one  of  the  examiners 
assisting  Dean  (afterwards  Bishop)  Lancelot  Andrews,  and  took 
part  in  the"appositions . " Then  the  four  principal  scholars 
pronounced  orations,  the  captain  and  the  second  scholar  in 
G-reek,  the  third  and  fourth  scholars  in  Latin.  Mr.  Owyn  (Doctor 
of  Physic),  one  of  the  examiners,  made  a learned  answer  to  the 
captain's  oration.  Sixteen  of  the  principal  scholars  were  then 
examined  and  a theme  given  them  to  write  whilst  the  examiners 
went  to  dinner.  Three  scholars  were  then  chosen  for  St.  John's 
College,  Oxford.  In  1601,  after  forty  years'  work,  the  school 
statutes  were  revised  and  it  was  decided  to  recommend  a 
"probation"  of  the  school  three  times  a year.  This  probation 
was  to  be  made  by  the  master.  The  testing  was  to  last  a day 
from  half-past  six  in  the  morning  till  eleven,  and  from  12:30 
till  five  o'clock  in  the  afternoon.  All  forms  were  to  be 
examined  in  writing.  Precautions  were  to  be  taken  against 
prompting  and  copying.  No  dialogue,  epistle,  theme,  sentence, 
or  verse  was  to  be  set  twice  in  the  same  year.  Ample  time  was 
to  be  given  to  all,  but  failure  to  do  the  exercises  well  (by 
any  negligence  or  lack  of  ability)  for  these  probations  was 
to  result  in  dismissal.  A register  of  the  school's  probation  was 
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to  be  kept,  in  it  to  be  entered,  the  name  of  each  boy  in  each 
of  the  six  forms,  length  of  stay  in  the  school,  what  books  he 
had  read  and  how  far  in  them  he  had  read,  and  a record  of  his 
exercises.  A comparison  was  thus  to  be  made,  and  a permanent 
record  kept,  of  progress  from  Probation  Day  to  Probation  Day. 

The  master  and  his  three  teachers  were  to  receive  6s.  8d*  each  for 
their  work  in  examining. 


The  governors  of  the  "greatest  school  in  England  under  one 
roof"  committed  the  examination  to  the  masters  "without  any 
association"  with  them  of  outside  examiners;  first  because  of 
their  assured  confidence  in  them;  secondly,  because  the  presence 
of  strangers  would  hinder  boys;  thirdly,  because,  if  a strange 
assembly  were  present,  they  would  take  off  the  master* s attention 
as  well  as  distract  the  minds  of  the  boys.  Thus  the  Visitation 
(q.v.)  of  the  school  by  the  Diocesan  led  first  to  oral 
examination  by  the  bishop  and  other  learned  men,  then  to  the 
probation  by  the  headmaster  and  teachers  themselves,  to  be 
!'  reviewed  by  the  bishop  or  visitor  and  the  Court  of  Governors 
and  their  friends.  The  examinations  were  the  preludes  to  the 
choice  of  scholars  for  the  university.  With  the  visiting  of 
the  examiners  and  the  governors,  there  sprang  up  the  idea  of 
a school  show  day,  the  Declamation  Day,  as  it  was  often  called, 
to  which  governors,  parents,  and  those  interested  in  the 
school,  either  magnates  or  the  public,  came  that  all  might 
rejoice  together  in  the  performances  of  the  pupils.  It  will 
be  seen  that  the  plan  of  probation  at  Merchant  Taylor* s School 
embodies  examinational  ideas  for  which  reformers  have  still  to 
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plead  to-day:  confidence  in  the  masters  to  conduct  their  own 

examinations,  a style  of  examination  devised  to  bring  out  active 
and  initiative  powers  of  pupils  even  more  than  to  test  mere  re- 
tentive capacity,  and  work  required  in  examination  to  be  quali- 
tative rather  than  quantitative.  This  latter  feature  is  the 
more  noticeable,  seeing  that  the  curricula  of  the  schools  in 
classics  was  so  extensive.  Perhaps  the  most  remarkable  point 
in  the  Merchant  Taylor’s  scheme  is  the  inclusion  of  the  register 
of  the  school’s  probation.  It  is  not  improbable  that  this  plan 
has  the  future  with  it.  For  it  is  a recognition  of  comparison 
not  only  of  pupil  with  pupil,  but  of  the  ability  of  a pupil  at 
one  probation  with  his  ability  at  the  next  and  following  proba- 
tions. It  is  thus  often  material  for  considering  the  progress 
of  abitity  as  well  as  the  attainment  of  a standard  of  knowledge. 
It  shows  the  power  of  using  knowledge  at  entrance,  and  all  along 
the  line  of  the  pupils'  course,  three  times  a year,  and  is  an 
indication  of  educational  process  in  the  individual,  instead  of 
being  mainly  concerned  with  competitive  merit  and  relative  pos- 
ition in  an  order  of  merit  according  to  some  objective  standard 
of  attainment. 

Examinations  of  school  were  required  by  the  statutes  of  St. 
Saviours'  G-rammar  School,  1562,  Tonbridge,  1564,  Oundle  School, 
1566,  St.  Albans,  1570,  Sandwich,  1580,  and  Codwell  (Hereford- 
shire), 1612.  The  system  was  therefore  established  in  schools 


by  the  time  of  the  sailing  of  the  Pilgrim  Fathers. 

It  was  not  until  the  second  half  of  the  nineteenth  century 
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that  the  examination  system  which  marks  English  education  re- 
ceived its  fullest  development,  until  at  the  present  day  the 
multiplication  of  examinations  and  examining  bodies  has  given 
rise  to  a situation  which  is  leading  to  a reconsideration  and 
reform  of  the  system.  But  whatever  arguments  may  be  adduced  in 
favor  of  or  against  examinations,  this  much  may  be  said  by  way 
of  preface,  that  English  education  could  never  have  reached  the 
present  state  of  development  without  the  influence  of  the  system 
pernicious  and  exaggerated  as  that  may  have  been.  Both  in  ele- 
mentary and  secondary  education  the  examinations  helped  to  stand 
ardize  schools  and  curricula;  they  introduced  new  branches  of 
study,  and  kept  teachers,  who  would  otherwise  have  been  ineffi- 
cient, to  certain  easily  formulated  and  definite  standards,  how- 
ever faulty  and  objectionable  these  may  be  in  the  light  of  later 
educational  theory. 

Elementary  education  was  submitted  to  the  controlling  in- 
fluence of  examinations  by  the  action  of  the  Rt.  Hon.  Robert 
Lowe,  who  in  1861  introduced  payments  by  results  as  the  most 
mechanical  ani  ready  method  of  measuring  efficiency.  All  child- 
ren over  six  years  of  age  in  the  elementary  schools  were  to  be 
examined  individually  once  a year  in  the  three  R's,  standards 
being  arranged  according  to  age.  Government  grants  were  paid 
according  to  the  results  and  tendencies.  A minimum  of  education 
was  thus  secured  to  children  of  all  abilities,  but  a monotonous 
uniformity  was  introduced.  Teachers  were  not  only  stimulated 
by  the  prospects  of  the  grant,  but  were  placed  at  the  mercy  of 
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local  managers  to  whom  the  grants  were  directly  paid.  The  sys- 
tem made  every  pupil  rate  perfect  in  the  three  R's.  One  inspec- 
tor even  ;ent  so  far  to  say  that  'the  studies  of  the  class- 
room must  be  those  wherein  progress  can  be  definitely  measured 
by  examinations."  Another  inspector,  in  dictating  out  of  a 
reader  which  had  been  used  by  the  school,  changed  some  of  the 
words , but  found  on  marking  the  papers  that  the  pupils  had  not 
noticed  his  changes,  and  evidently  had  learned  the  book  by  heart. 
Great  care  was  taken  by  managers  and  teachers  to  make  a good 
showing  on  the  d-,y  of  inspection;  the  premises  received  vigorous 
cleaning,  and  the  children  were  strongly  urged  to  appear  with 
clean  hands  and  faces  and  in  their  best  clothes.  The  system  did 
not  continue  without  considerable  opposition  from  those  inter- 
ested in  education.  Matthew  Arnold  (q.v.),  himself  an  inspector, 
reports  "That  the  mode  of  teaching  in  the  primary  school  has 
fallen  off  in  intelligence , spirit  and  inventiveness,"  owing  to 
the  introduction  of  the  mechanical  processes.  Slight  modifica- 
tions were  made  in  the  system;  the  amounts  of  the  grants  were 
altered;  additional  grants  were  given  for  "specific  subjects" 
(geography,  history,  algebra,  geometry,  and  any  other  scheme  of 
work  approved  by  the  inspector);  examinations  of  Standards  1 
and  11  were  abolished  in  1873  and  1874.  The  Royal  Education 
Commission  of  1886-1888  recognized  that  some  doubt  was  expressed 
whether  the  system  of  examinations  fosters  a healthy  feeling, 
and  was  inclined  to  believe  that  overpressure  both  of  teachers 
and  pupils  was  caused.  The  majority  held  that  "so  long  as  a 
money  value  is 
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attached  to  each  success  in  the  individual  examination  of  the 
children  attending  any  elementary  school,  and  so  long  as  the 
teachers  are  dependent  on  the  grant  for  part  of  their  income, 
there  is  great  risk  that  teachers,  in  considering  their  own 
reputation  and  emoluments,  may  endanger  the  health  and  welfare 
of  the  children."  In  the  same  period  an  agitation  was  conducted 
in  the  press  (see  Nineteenth  Century.  November,  1838,  and  Feb- 
ruary, 1889)  on  the  whole  question  of  examinations,  and  Mr* 
Auberon  Herbert  published  a collection  of  letters  under  the  tit]. 
The  Sacrifice  of  Education  of  Examination  (London,  1889).  As 
a result  individual  examinations  were  abolished  in  1890,  and 
examination  by  sample  " was  introduced,  by  which  the  inspectors 
could  examine  different  subjects.  In  1895  inspectors  could  vis! 
schools  without  previous  notice.  By  1897  the  system  of  payment 
by  results  was  abolished,  and  with  it  the  system  of  wholesale 
examinations  at  the  hands  of  the  government. 

A similar  system  of  examinations  and  payment  of  grants  on 
the  results  was  employed  by  the  Science  and  Art  Department, 
which  made  payments  to  schools  for  pupils  winning  prizes;  at 
first  only  six  subjects  were  offered  for  examination,  and  this 
number  was  gradually  raised  to  twenty-six.  Elementary  school 
teachers  qualified  themselves  by  obtaining  the  department  cer- 
tificate, and  by  teaching  science  subjects  in  the  evening  were 
able  to  secure  the  grant.  The  system  encouraged  the  rise  of 
schools  of  science  and  the  teaching  of  science  and  art  subjects 
in  secondary  schools.  Payments  by  results  were  abolished  by 
the  Department  in  1895. 
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In  the  two  systems  so  far  mentioned  there  was  at  any  rate 
a certain  amount  of  uniformity  in  standards  of  requirements  and 
in  organization.  But  it  was  in  the  field  of  secondary  educa- 
tion that  the  tyranny  of  examinations  and  examining  boards  with 
different  standards,  requirements,  organization,  and  dates  was 
felt.  In  1853  the  College  of  Preceptors  (q.v.)  began  a system 
of  examinations  in  secondary  school  subjects  (Latin,  French, 
English,  history,  mathematics,  geography,  drawing,  some  science 
and  Greek.  ) The  examination  was  open  to  both  boys  and  girls, 
and  certificates  were  given  on  the  results.  The  examinations 
were  held  twice  a year  at  local  centers.  In  1858  the  Society 
of  Arts,  which  in  1852  had  formed  a union  of  mechanics*  insti- 
tutes, proposed  to  hold  examinations  of  persons  over  fifteen 
years  of  age  on  leaving  school  in  mathematics,  English,  history 
Latin,  French,  and  German;  in  1873  technological  examinations 
were  added,  but  were  transferred  in  1879  to  the  City  and  Guilds 
of  London  Institute.  In  1858  Oxford  undertook  the  examination 
of  pupils  in  secondary  schools  through  a body  of  delegates,  and 
gave  the  degree  of  Associate  of  Arts  to  successful  candidates; 
girls  were  admitted  in  1870.  Cambridge  also  instituted  a sys- 
tem of  examinations  for  boys  only  in  1858,  and  extended  it  to 
girls,  who  were  allowed  to  take  the  papers  in  1863,  and  in  1865 
were  placed  on  the  same  footing  as  boys.  Preliminary  sections 
for  pupils  under  fourteen  were  also  instituted.  Centers  were 
established  not  only  all  over  Great  Britain  and  Ireland,  but 
also  in  the  colonies.  The  two  universities  held  their  examin- 
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ations  at  different  times  of  the  year.  When  in  1869  there  seern< 
a possibility  that  a government  examination  would  be  established 
for  secondary  schools,  as  a result  of  the  Endowed  Schools  Act, 
the  headmasters  at  their  conference  in  1870  urged  the  univers- 
ities to  take  up  the  work  and  to  grant  leaving  certificates 
which  would  exempt  from  entrance  examinations  to  the  universi- 
ties. The  result  was  the  establishment  of  the  Oxford  and 
Cambridge  Schools  Examination  Board,  or  the  Joint  Board,  in 
1873.  Oirls  were  admitted  to  the  examination  in  1878,  and  in 
1882  a junior  certificate  examination  was  instituted,  the  papers 
were  marked  by  the  masters  of  the  schools,  and  were  reported 
on  by  the  examiners.  London  University  held  its  first  examina- 
tion in  1838,  which  included  arithmetic  and  algebra,  English 
history,  geography,  3-reek,  Latin,  chemistry,  natural  history, 
geometry,  and  classical  history.  Students  took  first  the  pass 
papers  and  then  honors.  At  first  the  examination ,was  limited 
to  students  in  affiliated  colleges  of  the  university,  but  in 
1858  was  thrown  open.  This  examination  continued  to  increase 
in  difficulty,  and  complaints  were  heard  from  schools  until  the 
requirements  were  revised  in  1898.  '’Tien  the  University  of  Lon- 
don, by  act  of  1898,  again  became  a teaching  institution,  the 
external  examinations  for  external  students  were  retained. 

Local  examinations  are  also  conducted  by  Durham,  Birmingham, 


Manchester,  Liverpool,  Leeds,  and  Sheffield  universities,  the 
last  four  being  combined  as  a Joint  Matriculation  Board.  The 
University  of  Vales  and  the  Central  '.Yelsh  Board  also  hold  exam 
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inations  for  matriculation  and  leaving  certificates.  Other  ex- 
amining boards  are  the  London  Chamber  of  Commerce,  the  City  and 
Guilds  Technical  College,  and  the  Lancashire  and  Cheshire  Insti- 


tute, which  are  concerned  mainly  with  examinations  in  technical 
and  scientific  subjects.  This  does  not  exhaust  the  list  of  ex- 
aminations or  examining  bodies;  Oxford  and  Cambridge  in  many 
cases  Insist  on  candidates  passing  either  in  whole  or  in  part 
the  Responsions  and  Previous  Examinaions,  which  their  colleges 
may  insist  on  an  additional  matriculation  examination.  Further, 
none  of  the  above  examinations  usually  count  anything  toward 
scholarships  or  prizes,  nor  toward  the  examinations  for  entrance 
into  the  training  schools  for  the  army,  navy,  (Woolwich,  Sandhur 
Osborne)  or  into  the  civil  service.  The  different  branches  of 
the  public  services  have  their  own  entrance  examinations,  which 
have  led  to  the  establishment  of  numerous  "cramming"  institution 
One  of  the  evils  of  the  examinations  for  the  lower  branches  of 
the  civil  service  is  that  boys  and  girls  tend  to  leave  the  reg- 
ular secondary  schools  for  the  crammer. 

It  is  only  within  recent  years  that  exemptions  have  been 
accepted  by  professional  bodies,  by  which  a certificate  of 
success  in  any  of  the  recognized  university  examinations  is 
accepted  in  lieu  of  their  own  preliminary  examinations.  But 
many  of  them  still  provide  their  own  examinations.  Among  these 
may  be  mentioned:  the  Institute  of  Chartered  Accountants;  the 

Society  of  Incorporated  Accountants  and  Auditors;  the  Institute 
of  Actuaries;  the  Royal  Institute  of  British  Architects;  the 
Institution  of  Civil  Engineers;  the  Law  Society;  the  General 
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Medical  Councils;  the  Pharmaceutical  Society  of  G-reat  Britain, 
etc . 
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The  evils  of  over  examination  are,  however,  beginning  to 
be  slowly  recognized.  In  1903  the  Consultative  Committee  of 
the  Board  of  Education  recommended,  after  conferences  with  sev- 
eral associations  representing  teachers,  the  establishment  of 
a representative  central  board  to  coordinate  and  control  stand- 
ard of  examinations  and  to  secure  the  interrecognition  of  cert- 
ificates. (See  Board  of  Education,  Circular . July  12,  1904.) 
Inspection,  both  by  universities  and  by  the  government,  is  grad- 
ually increasing  in  extent  and  importance.  Universities  are 
cooperating  with  each  other  and  combining  to  reduce  the  multi- 
plicity of  entrance  and  preliminary  examinations,  and  profess- 
ional bodies  are  recognizing  equivalents  and  granting  exemptions 
in  these.  The  external  examinations  and  their  attendant  evils 
are  supplemented  by  the  number  of  examinations  held  within  the 
schools  by  the  teachers.  Each  term  is  concluded  by  an  examin- 
ation in  all  the  work  immediately  preceding.  Promotions  from 
one  class  or  form  to  another  depend  on  the  results  of  the  term 
examination.  Increasing  attention,  however,  is  being  drawn  to 
the  importance  of  relying  on  the  teachers’  testimony  on  a pupil' 
work  and  on  the  pupil’s  record  in  the  classroom  rather  than  on 
the  results  of  an  examination,  which  may  be  vitiated  through 
several  causes. 

The  advantages  and  disadvantages  of  examinations  have  been 
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frequently  discussed,  and  several  points  stand  out  clearly 
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That  they  are  hygienically  harmful  to  the  majority  of  pupils  is 
shown  in  detail  in  the  following  article  ( EXAMINATIONS,  HYGIENE 
OF  ).  The  limitations  of  the  English  system  of  elementary  edu- 
cation were  eloquent  proof  that  examinations  do  not  constitute 
a satisfactory  basis  for  the  distribution  of  money  grants  to 
schools,  nor  do  they  secure  the  results  which  are  aimed  at  - 
general  educational  efficiency  (see  APPORTIONMENT  OF  FUNDS). 
Examinations  cannot  provide  the  best  kind  of  motives  for  study, 
and  do  not  secure  the  proper  type  of  interest  in  school  work; 

The  stimuli  afforded  are  adventitious  and  artificial.  Too  many 
accidental  conditions  may  enter  into  examinations  which  may 
counteract  their  value  as  test 3.  Further,  an  examination  over  a 
large  area  cannot  be  addressed  to  the  individual.  Frequently 
success  in  examinations  may  be  due,  not  to  innate  general  abil- 
ity, but  merely  to  retentive  powers.  Above  all,  external  exam- 
inations disorganize  school  work  and  tend  to  limit  the  good 
teacher  and  to  reduce  all  teaching  to  a dead  level  of  uniformity, 
and  in  most  cases  must  result  in  cramming.  That  the  evils  which 
follow  in  the  train  of  competitive  examinations  for  public  ser- 
vice appointments  are  less  harmful  than  the  old  system  of  nomin- 
ation by  political  influence  is  obvious;  but  another  question 
arises,  whether  national  efficiency  is  secured  by  the  present 
means.  There  is  a tendency  in  England  at  present  to  introduce 
more  widely  a system  of  oral  examinations  such  as  has  been  em- 
ployed recently  by  the  Admiralty  to  secure  officers  for  the 
navy,  and  by  the  West  Riding  Council  in  the  award  of  Scholarships 
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The  whole  question  of  whether  success  in  examinations  is  followe 

1 

; by  success  in  after-life  is  one  that  thas  never  been  submitted 
to  scientific  investigation.  F.W.&I.L.K. 


On  the  use  of  examinations  as  a classroom  procedure  for 
review,  see  REVIEW  EXAM INA IONS ; METHOD;  RECITATION. 

EXAMINATIONS,  HYGIENE  OF. -In  recent  years  there  has  been  a 
strong  movement  for  the  abolition,  or  at  least  the  limitation, 
of  school  examinations  on  account  of  the  many  evils,  hygienic 
and  pedagogical,  that  seem  to  be  inevitably  connected  with  such 
tests.  There  seems  to  be,  however,  a fairly  general  consensus 

1 

of  opinion  that  examinations  of  some  kind  are  necessary,  and 
Whence  the  hygienic  aspects  of  the  subject  are  of  special  import- 
1 ance. 

Hygiene  is  concerned  both  with  the  direct  results  of  exam- 
ination in  their  bearing  upon  the  health,  and  also  with  certain 
secondary  and  indirect  results  of  examination.  The  data  in  re- 

j 

gard  to  the  direct  effect  have  accumulated  in  great  abundance. 

!j  Examinations  are  often  the  cause  of  overpressure,  and  serious 
physical  disorder  is  not  infrequently  produced  by  the  strain  of 
!i  preparation  and  of  performance.  Especially  in  England,  Germany, 

and  other  European  countries  has  this  been  the  case.  Studies 

ij 

in  Russia,  where  examinations  often  extend  over  a period  of  sev- 

I 

eral  wee ks,  have  shown  loss  of  weight  and  other  indications  of 
physical  strain  in  pupils  at  such  periods.  In  Germany  fear  of 
examination  has  been  found  to  be  frequently  one  of  the  causes  of 

!,  suicide  among  school  children. 

I< 
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In  this  country  we  have  no  results  of  special  investiga- 
tions  concerning  the  effect  of  examination  on  the  health  of 
school  children,  but  the  reports  of  innumerable  observers  show 
that  frequently  there  is  dangerous  nervous  strain;  and  that 
even  the  best  students  often  cram  before  examinations  in  an  un- 
hygienic  manner  will  be  hardly  denied  by  any  who  are  young  en- 
ough to  recall  their  own  student  days.  In  great  universities 
in  this  country  the  writer  has  seen  mature  students  of  industri 
ous  habits  become  more  or  less  abnormal,  not  to  say  pathologica 
in  their  mental  activity  on  the  eve  of  examination,  and  exhibit 
the  phenomena  of  over-fatigue  during  the  examination  itself, 
i The  pressure  of  examination  is  likely  to  fall  hardest  on  those 
who  least  need  the  stimulus,  and  instances  of  overwork  before 
examination  are  not  rare  among  the  best  students.  Considering 
j|  the  matter  from  the  standpoint  of  psychology,  such  violent 
mental  athletics  are  both  wasteful  and  injurious.  Modern  psy- 
chology and  psychiatry  make  plain  the  need  of  regularity  in  in- 
tellectual work  and  the  danger  of  any  kind  of  abnormal  mental 
activity.  The  unnatural  method  of  study  on  the  part  of  the  ex- 
j aminee  of  which  the  protestants  in  the  Nineteenth  Century  com- 
plained  is  all  too  prevalent  in  this  country.  The  evil  here 
may  be  less  in  degree,  but  it  is  of  the  same  kind. 


There  are,  besides,  certain  secondary  results  of  examina- 
tion which  are  distinctly  evil,  as  they  tend  to  produce  habits 
of  unnatural  and  disorderly  thinking.  Some  of  these  are  illus- 
trated by  experimental  studies  that  have  been  made  in  Germany* 
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i Lobsien  has  made  interesting  experiments  on  the  psychology  of 
school  examinations.  He  wrote  on  a blackboard  twenty  simple  ex- 
amoles  in  arithmetic.  Fifty -four  boys  of  the  age  of  eight  were 
tested  by  him.  The  exoeriment  was  made  twice.  The  test  of  nor- 
mal conditions  was  similar  to  an  ordinary  study  hour  in  arithme- 
tic with  silent  reckoning.  Before  the  beginning  of  the  special 
test  the  children  were  told  that  their  work  would  be  considered 
as  an  examination  and  as  the  basis  far*  their  marks.  The  result 

5 

was  as  follows:  with  the  normal  test  there  were  39  per  cent  of 

the  examples  wrong;  with  the  soecial  test  50  per  cent.  The  ef- 
ji  feet  of  the  examination  was  to  cause  confusion  of  association 
and  error.  Lobsien  made  also  a similar  test  with  dictation  ex- 

1 ercises.  The  results  corroborated  those  of  the  first  experiment 

■ 

In  all  cases  the  examination  injured  the  character  of  the  per- 
formance, and  especially  in  the  case  of  the  poor  pupils. 

Lobsien  extended  this  experiment  also  to  the  qualitative  errors. 
The  greatest  number  of  errors,  namely,  42.7  percent,  occurred  in 
cases  of  words  which  came  under  definite  rules.  Plecher  has 
more  recently  made  experiments  to  test  the  results  found  by 
Lobsien,  although  without  testing  the  character  of  the  errors, 
and  has  found  similar  injurious  results.  Indications  of  emotion- 
al strain  were  also  found.  That  these  conditions  of  anxiety 

. 

were  actually  present  was  proved  by  an  experiment  v/hich  Plecher 
j performed  with  thirty -eight  children  twelve  years  of  age  in  a 

class  of  Sexta  of  the  common  school.  Some  davs  after  the  offi- 



cial  examination  at  the  close  of  the  year,  he  had  the  pupils 
I prepare  a so-called 
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:j  free  essay  in  regard  to  school  examinations . Of  thirty  boys, 
twenty-nine  testified  to  the  presence  of  a feeling  of  anxiety, 
of  course  in  the  most  varied  forms  of  expression:  "I  do  not 
trust  myself  to  speak";  "I  am  glad  of  the  examination,  but  when 
the  Herr  Oberlehrer  comes,  I am  afraid";  "if  I reckon,  for  ex- 
ample, two  hours,  I quite  lose  my  senses."  One  pupil  wrote, 

|i  "if  it  is  stated  that  we  have  an  examination  to-day,  then  a 
great  dread  comes  over  me,  because  I always  think  I shall  do 
everything  wrong.  The  thought  always  keeps  working  in  me,  and 
then  with  the  best  of  will,  I can  do  nothing.  ’Then  we  are 
through,  then  the  anxiety  no  longer  remains." 

Squally  bad,  perhaps,  are  the  habits  of  study  fostered  by 
preparation  for  examination.  It  is  a mere  commonplace  to  say 
that  in  many  schools  the  best  preparation  for  an  examination 

i 

is  to  have  in  memory  a vast  number  of  details.  The  student  may 
enter  the  examination  in  such  a condition  of  brain  fatigue  that! 
he  would  find  it  difficult  to  solve  a simole  original  problem; 
i!  but  if  he  have  this  plethoric  memory  of  details  he  will  succeed, 
A good  memory,  as  Helvetius  said,  is  a phenomenon  of  order. 

i 

The  normal  mind,  like  the  good  householder,  has  its  possessions 
stored  away  in  various  closets,  drawers,  and  pigeonholes,  or, 
in  technical  terms,  in  various  association  complexes;  the  stud-: 

ent  prepared  for  examination  is  like  the  unfortunate  man  w ho 

i| 

must  move  at  a sudden  alarm  and  has  all  his  goods  piled  together 
at  the  street  door  ready  for  the  truckman.  Normally  much  of 
!j  our  knowledge  is  unconscious.  Even  what  we  cannot  remember  is 
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not  wholly  lost,  Ebblnghaus  in  his  experiments  in  memorizing 
ij nonsense  syllables  found  that  even  where  the  memory  of  a series 

| of  syllables  was  so  evanescent  that  after  an  hour  it  could  not 

|i 

be  recalled,  a certain  hidden  skill  persisted  unconsciously, 
so  that  the  same  series  could  be  relearned,  even  after  the  in- 
terval of  a month,  in  much  less  time  than  a new  series.  For- 
getting is  a normal  function  of  the  mind.  Y/e  retain  compara- 
tively little  that  we  have  learned,  except  main  principles  and 
this  unconscious  element.  The  latter,  however,  is  valuable. 

It  is  this  that  makes  us  feel  at  home  in  a subject.  At  the  end 
of  a college  course  a large  part  of  one*s  acquisition  is  of  this 
i|kind;  the  ordinary  examination  cannot  gauge  it,  but  puts  a prem- 
ium upon  abnormal  mental  activity, 

!i 

Hygiene  requires  that  examinations  should  be  given  for  the 
sake  of  the  students,  and  not  in  behalf  of  an  Institutional  stan- 
dard. Apart  from  examinations  at  graduation  and  the  like,  the 
chief  reason  for  formal  tests  is  to  determine  a pupil* s fitness 

for  doing  profitably  a higher  grade  of  work.  When  this  can  be 

ii 

i determined  without  examination,  a formal  test  is  unnecessary. 

The  famous  German  educator,  Professor  Paulsen,  has  enumer- 
jated  the  rules  which  should  govern  examinations  from  a pedago- 
gicol  point  of  view.  There  is  an  almost  equally  good  code  of 
rules  from  the  point  of  view  of  hygiene  for  avoiding  the  evil 
secondary  results  of  examination.  They  arein  part  as  follows: 

ii 

(a)  Look  for  the  positive  acquisitions  of  the  student.  Exam- 
ination as  such  has  the  opposite  tendency  - it  gives  prominence 
to  the  deficiencies.  (b)  Begin  with  easy,  simple,  definite 
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questions.  The  missing  of  a question  and  answer  in  the  begin- 
ning frequently  confuses  and  upsets  the  whole  affair,  (c)  Treat 
errors  and  blunders  in  accordance  with  Galatians  vi,  1:  'Breth- 
ren, if  a man  be  overtaken  in  a fault,  ye  which  are  spiritual 
restore  such  an  one  in  the  spirit  of  meekness,  considering  thy- 
self lest  thou  also  be  tempted.’  (d)  Do  not  forget  for  most 
men  an  examination  does  not  afford  a good  opportunity  to  appear 
in  a favorable  light;  for  this  reason  subjoin,  as  occasion  may 
require,  addits  addendls.” 

The  special  demands  of  hygiene  in  regard  to  examination 
may  be  summed  up  briefly  and  dogmatically  as  follows:  (l)  No 
formal  written  examination  should  be  given  in  the  school  below 
the  sixth  grade.  (2)  Examinations  below  the  high  school  should 
not  be  more  than  forty  minutes  in  length,  and  in  the  high  school 
they  should  not  be  more  than  one  hour  in  length.  In  colleges, 
higher  technical  schools,  and  the  like,  no  examination  should 
last  more  than  three  hours.  (3)  Not  more  than  one  examination 
should  be  given  on  the  same  day  in  the  public  schools:  and  in 
the  colleges  and  higher  schools  not  more  than  one  three-hour  ex- 
amination or  two  one-hour  examinations  should  be  given  on  the 
same  day.  (4)  Periods  of  examination  extending  over  several  week* 
as  in  some  European  countries,  should  not  be  permitted.  (5)  The 
sanitary  conditions  of  the  examination  room  as  regards  adequate 
light,  good  ventilation,  suitable  temperature,  and  adequate  hum- 
idity of  the  air  should  be  always  provided  for.  (6)  Hygiene  joins 
with  pedagogy  in  emphasizing  the  advantages  of  examination  ques- 
tions which  test  ability  and  power  of  straightforward  thinking 
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over  examinations  that  put  a premium  on  cramming,  l.e.  original 
problems,  translations  at  sight,  the  writing  of  original  themes, 
and  the  like.  W.  H.  B. 
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Examinations 

The  following  is  copied  verbatim  from  the  Encyclopaedia  Britan- 
nica.  Eleventh  Edition,  Volume  X,  Cambridge,  England:  at  the 
University  Press,  New  York,  35  '-Vest  32nd  Street.  Pub.  in  1910, 
pp.  41-49  incl. 

EXAMINATION.  The  term  " examination”  (i,  e.  inspecting, 
weighing,  and  testing;  from  Lat.  ex^men.  the  tongue  of  a balance) 
is  used  in  the  following  article  to  denote  a systematic  test  of 
knowledge,  and  of  either  special  or  general  capacity  or  fitness, 
carried  out  under  the  authority  of  some  public  body. 

1#  History . - The  oldest  known  system  of  examinations  in 
history  is  that  used  in  China  for  the  selection  of  officers  for 
the  public  service  (c.  1115  B.  C.).  See  CHINA;  also  W.  A.  P. 


and  Etienne  Zi,  Pratique  des  Examens  Lltteralres  en  Chine 
(Shanghai,  1894).  The  abolition  of  this  system  was  announced 
in  1906,  and,  as  a partial  substitute,  it  was  decided  to  hold 
an  annual  examination  in  Peking  of  Chinese  graduates  educated 


abroad  (Times . 22nd  of  October  1906). 

The  majority  of  examinations  in  western  countries  are  de- 
rived  from  the  university  examinations  of  the  middle  ages.  The 
first  universities  of  Europe  consisted  of  corporations  of  tea- 
chers and  of  students  analogous  to  the  trade  gilds  and  merchant 
gilds  of  the  time.  In  the  trade  gilds  there  were  apprentices, 
companions,  and  masters.  No  one  was  admitted  to  mastership  un- 
til  he  had  served  his  apprenticeship  (q.  v.),  nor,  as  a rule, 
until  he  had  shoxvn  that  he  could  accomplish  a piece  of  work 


Martin,  The  Lore  of  Cathay  (1901),  p.  311  et  seq.;  T.  L.  3 
"Competive  Examinations  in  China”  (Nineteenth  Century,  July  1894); 
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to  the  satisfaction  of  the  gild. 

The  object  of  the  universities  was  to  teach;  and  to  the  thre< 
classes  established  by  the  gild  correspond  roughly  the  scholar. 
the  bachelor,  or  pupil-teacher  (see  Rashdell  i.  209,  note  2,  and 
221,  note  5),  and  the  master  or  doctor  (two  terms  at  first  equi- 
valent) who,  having  served  his  apprenticeship  and  passed  a def- 
inite technical  test,  had  received  permission  to  teach.  The 
early  universities  of  Europe,  being  under  the  same  religious 
authority  and  animated  by  the  same  philosophy,  resembled  each 
other  very  closely  in  curriculum  and  general  organization  and  ex 
aminations,  and  by  the  authority  of  the  emperor,  or  of  the  pope 
in  most  cases,  the  permission  to  teach  granted  by  one  university 
was  valid  in  all  (jus  ubicunque  docendi). 

The  earliest  university  examinations  of  which  a description 
is  available  are  those  in  civil  and  in  canon  law  held  at  Bologna 
at  a period  subsequent  to  1219.  The  student  was  admitted  with- 
out examination  as  bachelor  after  from  four  to  six  years'  study, 
and  after  from  six  to  eight  years"  study  became  qualified  as  a 
candidate  for  the  doctorate.  He  might  obtain  the  doctorate  in 
Doth  branches  of  law  in  ten  years  (Rashdall  i.  221-222). 

The  doctoral  examination  at  Bologna  in  the  13th-l4th  cent- 
iries  consisted  of  two  parts  - a private  examination  which  was 
a real  test,  and  a public  one  of  a ceremonial  character  (conven- 
bus ) . The  candidate  first  took  an  "o„th  that  he  had  complied 
with  all  the  statutable  conditions  that  he  would  give  no  more  th4n 
the  statutable  fees  or  entertainments  to  the  rector  himself,  the 
doctor  or  his  f ellow-3tudents,  and  that  he  would  obey  the  rector. 
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He  wis  then  presented  to  the  archdeacon  of  Bologna  by  one  or  mor 
doctors,  who  were  required  to  have  satisfied  themselves  of  his 
fitness  by  private  examination.  On  the  morning  of  the  examina- 
tion, after  attending  mass,  he  was  assigned  by  one  of  the  doc- 
tors of  the  assembled  college  two  passages  (ouncta)  in  the  civi 
or  canon  law,  which  he  retired  to  his  house  to  study,  possibly 
with  the  assistance  of  the  Dresenting  doctor.  Later  in  the  day 
he  gave  a lecture  on,  or  exposition  of,  the  prepared  passages, 

, and  was  examined  on  them  by  two  of  the  doctors  appointed  by  the 
college.  Other  doctors  might  then  put  supplementary  questions 
on  law  arising  out  of  the  passages,  or  might  suggest  objections 
to  his  answers.  The  vote  of  the  doctors  present  was  taken  by 
ballot,  and  the  fate  of  the  candidate  was  determined  by  the  maj- 
ority. The  successful  candidate,  who  received  the  title  of  lic- 
entiate, was,  on  payment  of  a heavy  fee  and  other  expenses,  per 
mitted  to  proceed  to  the  conventus  or  final  public  examination. 
This  consisted  in  the  delivery  of  a speech  and  the  defence  of  a 
thesis  on  some  point  of  law,  selected  by  the  candidate,  against 
opponents  selected  from  among  the  students.  The  successful  can- 
didate received  from  the  archdeacon  the  formal  "licence  to  teach 
by  the  authority  of  the  pope  in  the  name  of  the  Trinity,  and  was 

ii 

invested  with  the  insignia  of  office.  At  Bologna,  though  not  at 
Paris,  the  "permission  to  teach"  soon  became  fictitious,  only  a 
small  number  of  doctors  being  allowed  to  exercise  the  right  of 
teaching  in  that  university  (Rashdall). 

In  the  faculty  of  arts  of  Paris,  towards  the  end  of  the 
ij  13th  century,  the  system  was  already  more  complicated  than  at 
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Bologna.  The  baccalaureate,  licentiateship,  and  mastership 
formed  three  distinct  degrees.  For  admission  to  the  baccalau- 
reate a preliminary  test  or  "Responsions"  was  first  required, 
at  which  the  candidate  had  to  dispute  in  grammar  or  logic  with 
a master.  The  examiners  then  inspected  the  certificates  ( sched^ 
ulae ) of  residence  and  of  having  attended  lectures  in  the  pre- 
scribed subjects,  and  examined  him  in  the  contents  of  his  books* 
The  successful  candidate  was  admitted  to  maintain  a thesis 
against  an  opponent,  a process  called  "determination"  (see 
Rashdall  i.443  et  seq.),  and  as  bachelor  was  then  permitted  to 
give  "cursory"  lectures.  After  five  or  six  years  from  the  date 
of  beginning  his  studies  (matriculation)  and  being  twenty  years 
of  age  (these  conditions  varied  at  different  periods),  a bach- 
elor was  permitted  to  present  himself  for  the  examination  for 
the  licentiateship,  which  was  divided  into  two  parts.  The  first 
part  was  conducted  in  private  by  the  chancellor  and  four  exam- 
iners (temotatores  in  cameris).  and  included  an  inquiry  into  the 
candidate's  residence,  attendance  at  lectures,  and  performance 
of  exercises,  as  well  as  examination  in  prescribed  books;  those 
candidates  adjudged  worthy  were  admitted  to  the  more  important 
examination  before  the  faculty,  and  names  of  successful  candi- 
dates were  sent  to  the  chancellor  in  batches  of  eight  or  more  at 
a time,  arranged  in  order  of  merit.  (The  order  of  merit  at  the 
examination  for  the  licentiateship  existed  in  Paris  till  quite 
recently. ) Each  successful  candidate  was  then  required  to  main- 
tain a thesis  chosen  b y himself  (quodlibetica ) in  St.  Julian's 


66 


I 


II 


I 


67 


church,  and  was  finally  submitted  to  a purely  formal  public  ex- 
amination (collatio)  either  the  episcopal  palace  or  the  abbey  of 
Ste.  Genevieve,  before  receiving  from  the  chancellor,  in  the 
name  of  the  Trinity,  the  licence  to  incept  or  begin  to  teach  in 
the  faculty  of  arts.  After  some  six  months  more  the  licentiate 
took  part  "in  a peculiarly  solemn  disputation  known  as  his  'Ves- 
pers, 1 ’ then  gave  his  formal  inaugural  lecture  or  disputation 
before  the  faculty,  and  was  received  into  the  faculty  as  master. 
This  last  process  was  called  "inception". 

In  discussing  the  value  of  medieval  examination  of  the  kind 
described,  Paulsen  (The  German  Universities  (1906),  p.  25)  as- 
serts that  they  were  well  adapted  to  Increase  a student's  alert- 
ness, his  power  of  comprehending  new  ideas,  and  his  ability  quick 
ly  and  surely  to  assimilate  them  to  his  own,  and  that  "they  did 
more  to  enable  (students)  to  grasp  a subject  than  the  mute  and 
solitary  reviewing  and  cramming  of  our  modern  examinations  can 
possibly  do."  At  their  best  they  fulfilled  precisely  the  tech- 
nical purpose  for  which  they  were  intended;  they  fully  tested  th$ 

capacity  of  the  candidate  to  teach  the  subjects  which  he  was  re- 
quired to  teach  in  accordance  with  the  methods  which  he  was  re- 
quired to  use.  The  limitations  of  the  test  were  the  limitations 
of  the  educational  and  philosophic  ideals  of  the  time,  in  which 
a dogmatic  basis  was  presupposed  to  all  knowledge  and  criticism 
was  limited  to  the  suoer3tructure.  At  their  worst,  even  with  ven 
il  examiners  (and  additional  fees  were  often  offered  as  a bribe), 
^ashdall  regards  these  examinations  (at  the  end  of  the  13th  cen- 
tury) as  probably  "less  of  a farce  than  the  pass  examinations 
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of  Oxford  and  Cambridge  almost  within  the  memory  of  persons  now 
living*"  It  is,  however,  to  be  pointed  out  that  the  standard 
in  Paris  and  elsewhere  at  a later  date  became  scandalously  low 
in  some  cases.  In  some  universities  the  sons  of  nobles  were  reg- 
ularly excused  from  certain  examinations.  At  Cambridge  in  1774- 
Fellow  Commoners  were  examined  with  such  precipitation  to  ful- 
fil the  formal  requirements  of  the  statutes  that  the  ceremony 
wo s termed  "huddling  for  a degree"  (jebb,  Remarks  upon  the  Pre- 
sent Lhde  of  Education  in  the  University  of  Cambridge,  4th,  ed. , 
1774,  p.  32).  The  last  privileges  of  this  kind  were  abolished 
at  Cambridge  by  a grace  passed  on  the  20th  of  March  1884. 

In  the  medieval  examinations  described  above  we  find  most 
of  the  elements  of  our  present  examinations:  certificates  of 
previous  study  and  good  conduct,  preparation  of  set-books,  ques- 
tioning on  subjects  not  specially  prepared,  division  of  examin- 
ations into  various  parts,  classification  in  order  of  merit, 
payment  of  fees,  the  presentation  of  a dissertation,  and  the  de- 
fence and  publication  of  a thesis  (a  term  of  which  the  meaning 
has  now  become  extended). 

The  requirement  to  write  answers  to  questions  written  or 
dictated,  to  satisfy  a practical  test  (other  than  in  teaching), 
and  a clinical  test  in  medicine,  appear  to  be  of  later  date. 

W.  W.  Rouse  Ball  in  his  History  of  the  Study  of  Mathematic 
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at  Cambridge  (1889),  p.  193,  states  that  he  can  find  no  record 
of  any  European  examinations  by  means  of  written  papers  earlier 
than  those  introduced  by  R.  Bentley  at  Trinity  College,  Cambridge 
in  1702. 
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The  medieval  candidate  for  the  doctorate  in  medicine,  although 
required  to  have  attended  practice  before  presenting  himself, 
discussed  as  his  thesis  a purely  theoretical  question,  often 
semi-theological  in  character,  of  which  as  an  extreme  example 
may  be  quoted  "whether  Adam  had  a navel.1* 

The  competitive  system  'was  developed  considerably  at  Louvain, 
; and  in  the  15th  century  the  candidates  for  the  master-ship  of 
arts  were  divided  into  three  classes  (rlgorosi . honour-men; 
transiblles . pass-men;  gratlosi . charity-passes),  while  a fourth, 
which  was  not  published,  contained  the  names  of  those  who  failed. 
In  the  17th  century  the  first  class  comprised  the  names  of 

twelve,  and  the  second,  of  twenty -four,  candidates  who  were  div- 

ii 

ided  on  the  report  of  their  teachers  into  classes  before  the  ex- 
amination, and  finally  arranged  in  order  of  merit  by  the  exam- 

1 

iners.  (Vernulaeus,  auoted  by  Sir  W.  Hamilton.  Discussions. 

_ — 

1852;  p.647;  Rashdall,  loc . cit . ii . 262).  At  the  Cambridge 
jj  tripos  (as  described  by  Jebb  in  1774,  RE -.-ARKS . &c . . pp. 20-31)  the 
first  twenty-four  candidates  were  also  selected  by  a preliminary 
test;  they  were  then  divided  further  into  "wranglers"  (the  dis- 

ii  . 

putants,  par  excellence)  and  Senior  Optlmes.  the  next  twelve  on 
the  list  being  called  the  Junior  Optlmes.  These  names  have  in 
the  mathematics  tripos  survived  the  procedure.  (The  name  Tripos 


is  derived  from  the  three-legged  stool  on  which  "an  old  bachelor^ 
selected  for  the  purpose,  sat  during  his  disputation  with  the 
senior  bachelor  of  the  year,  who  was  required  to  propound  two 
i questions  to  him. ) 
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The  subjects  in  which  the  medieval  universities  examined 
were  (i)  those  of  the  trivium  and  quadrivium  in  the  faculty  of 
arts;  ( I I ) theology;  (III)  medicine;  and  (IV)  civil  and  canon 
law.  The  number  of  subjects  in  which  examinations  are  held  has 
since  grown  immensely.  We  can  only  sketch  in  outline  the  trans 
formations  of  certain  typical  university  systems  of  examination 
At  Oxford  there  is  no  record  of  a process  of  formal  exam- 
ination on  books  similar  to  that  of  Paris  (Rashdall,  ii.  442  et 
seq.),  disputations  being  apparently  the  only  test  applied  in 
its  early  history.  Examinations  were  definitely  introduced  for 
the  B.A.  and  M.A.  degrees  by  Laud  in  1636-1638  (Brodrick,  His- 
tory of  Oxford.  p.ll4),  but  the  standard  prescribed  was  so  much 
beyond  the  actual  requirements  of  later  times  that  it  may  be 
doubted  if  it  was  enforced.  The  studies  fell  in  the  18th  cen- 
tury into  an  "abject  state,"  from  which  they  were  first  raised 
by  a statute  passed  in  1800  (Report  of  Oxford  University  Com- 
mission of  1850-1852.  p.60  et  seq.),  under  which  distinctions 
were  first  allotted  to  the  ablest  candidates  for  the  bachelor's 


s 


degree.  Further  changes  were  made  in  1807  and  1825;  and  in 


1830  a distinction  was  made  betv^een  honours  examinations  of  a 
more  difficult  character,  at  which  successful  candidates  were 
divided  into  four  classes,  and  pass  examinations  of  an  easier 
character.  By  the  statutes  of  1849  and  1858  an  intermediate 
"moderations"  examination  was  instituted  between  the  prelimin- 
ary examination  called  "Responsions"  and  the  final  examination. 
Since  1850,  although  fresh  subjects  of  examination  have  been 
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introduced,  no  considerable  change  of  system  has  been  made. 

The  bachelor’s  degree  at  Oxford  tended  from  an  early  period 
to  be  postponed  to  an  advanced  stage  of  studies,  while  the  re- 
quirements for  the  master's  degree  diminished  until,  in  1807, 
the  examination  for  the  M.A.  was  abolished.  It  is  now  awarded 
to  bachelors  of  three  years'  standing  on  payment  of  a fee.. 

Cambridge  in  early  times  followed  the  example  of  Oxford, 
and  here  also  the  bachelor's  degree  became  more  and  more  import- 
ant (Bass  Kullinger,  History  of  the  University  of  Cambridge  from 
1535.  ...  ,p. 4-1 4),  and  the  M.A.  has  been  finally  reduced  to  a mere 
formality,  awarded  on  terms  similar  to  those  of  the  sister  uni- 
versity. The  standard  of  examinations  was  raised  in  Cambridge 
at  an  earlier  date  than  at  Oxford,  and  in  the  18th  century  the 
tripos  "established  the  reputation  of  Cambridge  as  a School  of 
Mathematical  Science."  The  school,  however,  produced  few,  if  any, 
great  mathematicians  between  Newton  and  3-eorge  G-reen.  It  was 
:>nly  between  1830  and  1840  that  the  standard  of  the  tripos  became 
i high  one.  At  Cambridge  there  is  no  intermediate  examination 
cetween  the"Previous  Examination"  (commonly  called  "Little-go"), 
which  corresponds  to  Oxford  "Responsions"  or  "Smalls"  and  the 
mriposes  and  examinations  for  the"Poll"  degree,  which  correspond 
:o  the  Oxford  final  honours  and  pass  examinations  respectively. 

But  most  of  the  triposes  have  been  divided  into  two  parts,  of 
which  the  second  is  not  obligatory  in  order  to  obtain  a degree. 

The  "senior  wrangler"  wq.s  the  first  candidate  in  order  of  merit 
in  the  first  part  of  the  mathematical  tripos.  The  abolition  of 
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order  of  merit  at  this  examination  was  decided  on  in  1906,  and 
names  of  candidates  appeared  in  this  order  for  the  last  time  in 
1909. 

At  the  Scottish  universities  the  B.A.  degree  has  become 
extinct,  and  the  M.A.,  awarded  on  the  results  of  examination,  is 
the  first  degree  in  the  faculty  of  arts. 

"The  incorporation  of  the  university  of  London  in  1836 
marks  an  era  in  the  history  of  examinations;  the  teaching  and 
examining  functions  of  a university  were  dissociated  for  the 
first  time.  Until  1858  the  London  examinations  were  ooen  only 
to  students  in  affiliated  colleges,  and  the  teachers  had  no  share 
in  the  appointment  of  the  examiners  or  in  determining  the  curri- 
cula for  examinations;  in  1858  the  examinations  werethrown  open 
to  all  comers,  and  no  requirements  were  insisted  on  with  regard 
to  courses  of  study  except  for  degrees  in  the  faculty  of  medicine. 
The  sole  function  of  the  university  was  to  examine,  and  its  exam-i 
inations  for  matriculation  and  for  degrees  in  arts  and  science 
were  carried  on  by  means  of  written  papers  not  only  in  London 
but  in  many  centers  in  the  United  Kingdon  and  the  colonies.  From 
the  first  the  degrees  were  (unlike  those  of  Oxford  and  Cambridge 
until  1871)  open  to  all  male  persons  without  religious  distinc- 
tions; and  in  1878  they  were  opened  to  women,  (Tripos  examinations 
were  thrown  open  to  women  at  Cambridge  by  the  grace  of  24th  Feb. 
1881,  and  at  Oxford  women  were  admitted  to  examinations  for  hon- 
ors by  statute  of  29th  April  1884.  Proposals  to  admit  women  to 
university  degrees  were  rejected  by  Oxford  and  Cambridge  in  1896 
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and  1897  respectively.) 

The  standard  of  difficulty  set  by  the  university  of  London 
was  a high  one,  very  much  higher  for  its  pass  degrees  than  the 
corresponding  standards  at  Oxford  and  Cambridge,  while  the  stand- 
ard for  honours  was  equally  high.  In  medicine  the  examinations 
were  made  both  wider  in  range  and  more  searching  than  those  of 
any  other  examining  body.  But,  for  reasons  dealt  with  below, 
great  discontent  was  roused  by  the  new  system.  In  1880  the 
Victoria  University,  "anchester,  was  established,  in  which  teach- 
ing and  examining  were  again  untied;  and  in  the  universities 
since  established,  with  the  exception  of  the  Royal  University  of 
Ireland  (which  was  created  in  1880  as  an  examining  body  on  the 
Lodel  of  London,  but  which  was  dissolved  under  the  Irish  Univer- 
sities  Act  1908,  and  replaced  by  the  National  University  of 
Ireland  and  the  Queen's  University  of  Belfast),  the  precedent  of 
Victoria  has  been  followed.  By  an  act  passed  in  1898,  of  which 
the  provisions  came  into  force  in  1900,  the  university  of  London 
was  reconstituted  as  a teaching  university,  although  provisions 
was  made  for  the  continuance  of  the  system  of  examinations  by 
'external  examiners"  for  "external  students,"  together  with"in- 
eernal  examinations"f or "internal  students,"  in  which  the  teachers 
^.nd  the  external  examiners  of  the  university  are  associated.  The 
examinations  in  music  and  the  final  examinations  in  law  and  med- 
icine are  carried  on  (1910)  both  for  "internal"  and  "external" 
students  by  "external"  examiners  only,  who  are,  however,  appoint- 
ed on  the  recommendation  of  boards  of  studies  consisting  mainly 
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of  London  teachers. 

At  the  university  of  Dublin,  examinations  have  been  main- 
tained both  for  the  B. A . and  M.A.  degrees  and  students  may  be 
admitted  to  the  examinations  in  subjects  other  than  divinity, 
law, medicine,  and  engineering  without  attendance  at  university 
courses . 

The  examinations  of  the  newer  universities,  the  Victoria 
University  of  Manchester,  Birmingham,  Liverpool,  Leeds, 

Sheffield  and  Vales,  are  open  only  to  students  at  these  univer- 
sities, and  are  conducted  by  the  teachers  in  association  with 
one  or  more  external  examiners  for  each  subject.  In  some  uni- 
versities, e.g.  Manchester,  the  M.A.  degree  is  given  after  ex- 
amination to  students  who  have  taken  a pass,  and  without  exam- 
ination to  those  who  have  taken  an  honours  degree. 

The  universities  which  have  departed  farthest  from  the 
medieval  system  of  examinations,  at  any  rate  in  appearance,  are 
those  of  Germany.  The  baccalaureate  has  disappeared,  but  stu- 
dents cannot  be  matriculated  without  having  passed  the 
Abi turien ten -exam en  (see  below),  probably  the  most  severe  of  all 
entrance  examinations  (foreign  students  may  be  exempted  under 
certain  conditions).  The  student  desiring  to  proceed  to  the 
doctorate  is  free  from  examinations  thereafter  until  he  presents 
his  thesis  for  the  doctor’s  degree,  when,  if  it  is  accepted  he 
is  submitted  to  a public  oral  examination  not  only  in  his  prin- 
cipal subject  (Hauptfach) , but  also  as  a rule  in  two  or  more 
collateral  subjects  (Nebenfacher ) . The  doctor's  degree  does  not 


give  the  right  to  teach  in  a faculty  (venia  legendi).  To  acquir^ 
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this  a doctor  must  present  a further  thesis  (Habllitatlonsschrift ) , 
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and  must  deliver  two  lectures,  one  before  the  faculty,  followed 
by  a discussion  (colloquium ) . the  other  in  public;  but  these 
lectures  "seem  to  be  merely  secondary  and  are  tending  to  become 
so  more  and  more";  "scientific  productiveness  is  so  sharply 
emphasized  among  the  conditions  for  admission  that  it  overshad- 
ows all  the  rest"  (Paulsen,  loc . p.  165). 

In  France  the  examination  for  the  baccalaureate,  though  con 
ducted  in  part  by  university  examiners,  has  become  a school- 
leaving examination  (see  below)-?  The  licentiateship  has  been 

i| 

i preserved  in  the  faculties  of  arts,  science  and  laws,  and  is  in 
point  of  difficulty  about  equal  to  the  pass  degree  examinations 
of  the  university  of  London,  though  differing  in  the  nature  of 

\ the  tests.  In  the  faculty  of  sciences,  the  three  subjects  of 
examination  selected  may,  under  a recent  regulation,  be  taken 

ii 

separately.  Until  a few  years  ago  the  successful  candidates  at 
the  licentiateship  were  arranged  in  order  of  merit.  For  the  doc- 
torate in  the  faculty  of  letters  two  theses  must  be  submitted, 

l! 

of  which  the  subject  and  plan  must  be  approved  by  the  faculty 

• (until  recently  one  of  them  was  required  to  be  written  in  Latin] 

I 

Permission  to  print  the  theses  is  given  by  the  rector  or  vice- 

rector  after  report  from  one  or  more  professors  and  they  are  then 

discussed  publicly  by  the  faculty  and  the  candidate  ( soutenance 

de  these) 

— ■ ■ '"■■■  1 ■■■ 

*'lt  should  be  mentioned  that  the  professors  of  chemistry 

; of  a number  of  German,  Austrian,  and  Swiss  universities,  have, 
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j by  agreement,  instituted  an  intermediate  examination  in  that 
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subject  which  students  are  required  to  pass  before  beginning 
work  on  the  doctoral  thesis.  The  examination  of  the  students  is 
conducted  by  the  teachers  concerned.' 

In  this  public  discussion  the  "disputation"  of  the  middle 
ages  survives  in  its  least  changed  form.  The  literary  theses 
required  by  French  universities  are,  as  a rule,  volumes  of  sev- 
eral  hundred  pages,  and  more  important  in  character  even  than 
the  German  Habilitationsschrift.  The  possession  of  the  doctor- 
ate  is  a sine  qua  non  for  eligibility  to  university  chair,  and 
to  a lectureship  in  the  university  of  Paris. 

In  the  faculty  of  sciences  a candidate  for  the  doctorate 
may  submit  two  theses,  or  else  submit  one  thesis  and  undergo  an 
oral  examination. 

! 

For  the  doctorate  in  lgw,  a thesis  and  two  oral  examinations 
are  required. 

In  the  faculty  of  medicine  there  is  no  licentiateship,  but 
for  the  doctorate  six  examinations  must  be  passed  and  a thesis 
submitted. 

There  is  also  a special  doctorate,  the  "doctorat  d'  Unlver- 
sit&. " awarded  on  g thesis  and  an  oral  examination;  and  there  arb 
diplomas  (Dlplomes  d 'Etudes  sup&rleures)  awarded  on  dissertations 
and  examinations  on  subjects  in  philosophy,  history,  and  geogra- 
phy, classics  or  modem  languages,  selected  mainly  by  the  candi- 
date and  approved  by  the  faculty. 

1.  Professional  Examinations.  (a)  Teaching.  - University 

■I 

examinations  for  degrees  having  ceased  to  be  used  as  technical 
tests  of  teaching  capacity,  new  examinations  have  been  devised 
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for  this  purpose.  The  test  for  G-erman  university  teachers  has 
been  described  above.  For  secondary  teachers,  W.  von  Humboldt 
instituted  a special  examination  in  1810  (Paulsen,  G-esch.des 
gelehrten  Unterrichts,  ii.  pp.283  and  393),  and  an  examination 
for  primary  teachers  \7 as  instituted  in  Prussia  in  1794. 


In  France  there  is  a competitive  examination  for  secondary 
teachers,  the  agr^ation,  originally  established  in  1766.  Agr^g^: 
have  a right  to  state  employment  and  they  alone  can  occupy  the 
highest  teaching  post  (chaire  de  professeur)  in  a state  second- 
ary school,  other  posts  being  open  to  licentiates.  There  are 
also  examinations  for  primary  teachers.  The  tests  for  teachers 
are  different  for  the  two  sexes. 

In  England  there  is  no  obligators  test  for  secondary  teach- 
ers. The  universities  and  the  College  of  Preceptors  conduct 
examinations  for  teaching  diplomas.  The  Board  of  Education 
holds  special  examinations  (Preliminary  Certificate  examination 
and  Certificate  examination,  &c . ) for  primary  teachers. 

(b)  Medicine. --See  MEDICAL  EDUCATION 

(c)  Other  Prof essions . --A  system  of  professional  examina- 

tions carried  on  by  professional  bodies,  in  some  cases  with 
legal  sanction,  was  developed  in  England  during  the  19th  century 
Those  in  the  following  subjects  are  the  most  important:  Account 

ancy  (institute  of  Charteres  Accountants  and  Society  of  Account- 
ants and  Auditors),  actuarial  work  (institute  of  Actuaries), 
music  (Royal  Academy  of  Music,  Royal  College  of  Music,  Trinity 
College  of  Music,  Royal  College  of  Organists,  and  the  Incorpor- 
ated Society  of  Musicians),  pharmacy  (Pharmaceutical  Society), 
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plumbing  (the  Plumbers’  Company),  surveying  (Surveyors'  Institu- 


tion), veterinary  medicine  (Royal  College  of  Veterinary  Surgeons1, 
technical  subjects,  e ,g . cottonspinning,  dyeing,  motor-manufac- 
ture (City  & Guilds  of  London  Institute),  architecture  (Royal 
Institute  of  British  Architects),  commercial  subjects,  shorthand 
(the  Society  of  Arts  and  London  Chamber  of  Commerce),  engineering 
(Institutions  of  Civil  Engineers,  of  Mechanical  Engineers,  and 
of  Electrical  Engineers). 

3.  School-leaving  Examinations.-  The  faculty  of  arts  in  med- 
ieval universities  covered  secondary  as  well  as  higher  education 
in  the  subjects  concerned.  The  division  in  art  subjects  between 
secondary  and  university  education  has  been  drawn  at  different 
levels  in  different  countries.  Thus  the  first  two  years  of  the 
arts  curriculum  in  English  and  American  universities  correspond, 
roughly  speaking,  to  the  last  two  years  spent  in  a secondary 
school  of  Germany  or  France,  a.nd  the  continental  "school-leaving 
examinations"  correspond  to  the  intermediate  examinations  of  the 
newer  English  universities  and  to  the  pass  examinations  for  the 
degree  at  Oxford  and  Cambridge  (Mark  Patti  son.  Suggestions  on 
Academical  Organization.  1868,  p.238,  and  Matthew  Arnold,  Higher 
Schools  and  Universities  in  Germany.  1892,  p.209). 

A tabular  summary  is  given  (see  Tables  I, II, III, IV  on  pages 
45  and  46,  Encyclopaedia  Britannica)  of  the  requirements  of  the 
secondary  school-leaving  examinations  of  France,  Prussia  (for  the 
nine-year  secondary  schools)  and  Scotland,  and  of  the  university 
Of  London. 

There  are  in  England  a number  of  school  examinations  which, 
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under  prescribed  conditions,  also  serve  as  school-leaving  exam- 
inations, and  give  entrance  to  certain  universities,  especially 
the  Oxford  and  Cambridge  local  examinations  (both  established  in 
1858),  and  the  examinations  of  the  Oxford  and  Cambridge  "Joint 
Board."  A movement  to  reduce  the  number  of  entrance  examinations 
and  to  secure  uniformity  in  their  standard  was  set  on  foot  in 
1901.  In  that  year  the  G-eneral  Medical  Council  communicated  to 
the  Board  of  Education  a memorial  on  the  subject  from  the  Head- 
masters’ Conference.  The  memorial  was  further  communicated  to 
various  professional  bodies  concerned.  Conferences  were  held 
by  the  consultative  committee  of  the  Board  of  Education  in  1903, 
with  representatives  of  the  universities,  the  Headmasters  * Con- 
ference, the  Association  of  Head-Masters,  the  Association  of 
Head-Mistresses,  the  College  of  Preceptors,  the  Private  Schools' 
Association  , and  with  representatives  of  professional  bodies. 

The  committee  were  of  the  opinion  that  a central  board,  consist 
ing  of  representatives  of  the  Board  of  Education  and  the  differ 
ent  examining  bodies,  should  be  established,  to  co-ordinate  and 
control  the  standards  of  the  examinations,  and  to  secure  inter- 
changeability of  certificates,  &c.,  as  soon  as  a sufficient  num- 
ber of  such  bodies  signified  their  willingness  to  be  represented, 
on  the  board.  They  recommended  that  the  examination  should  be 
conducted  by  external  and  internal  examiners,  representing  in 
each  case  the  examining  body  and  the  school  staff  respectively, 
and  that  reports  on  the  school  work  of  candidates  should  be 
available  for  reference  by  the  examiners  (circular  of  the  Board 
of  Education  of  12th  of  July  1904). 
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The  "accrediting"  system  in  the  U nited  States  v/as  started 
by  the  university  of  Michigan  in  1871.  A school  desiring  to  he 
accredited  is  submitted  to  inspection  without  previous  notice. 

i; 

If  the  inspection  is  satisfactory,  the  school  is  accredited  by 
a university  for  from  one  to  three  years,  and  upon  the  favour- 

|l 

able  report  of  its  principal  any  of  its  students  are  admitted  to 
the  university  by  which  it  has  been  accredited  without  any  en- 
trance examination.  In  practice  it  is  found  that  many  students 
whom  their  teachers  refuse  to  certify  are  able  to  pass  the  uni- 
versity entrance  examination.  The  statistics  of  nine  years  show 
that  the  standard  of  the  certified  students  is  higher  than  that 
of  non-certif ied  students.  Two  hundred  and  fifty  schools  are 
accredited  by  the  university  of  Michigan.  In  1904  it  was  stated 
i that  the  system  was  gaining  favour  in  the  east,  and  that  it  had 
j been  adopted  more  or  less  by  all  the  eastern  colleges  and  uni- 
versities with  the  exception  of  Harvard,  Yale  Princeton  and 

j 

Columbia. 

4.  Methods  of  Examination. -Examinations  may  test  (i)  know- 
ledge, or,  more  exactly,  the  power  of  restating  facts  and  argu- 
ments of  a kind  that  may  be  learnt  by  rote;  (ii)  the  power  of 
j doing  something,  e.g.  of  making  a precis  of  written  document, 
ij  of  writing  a letter  or  a report  on  a particular  subject  with  a 
j1  particular  object  in  view,  of  translating  from  or  into  a foreign 
|!  language,  of  solving  a mathematical  problem,  of  criticizing  a 

Ii 

passage  from  a literary  work,  of  writng  an  essay  on  a historical 

j 

or  literary  subject  with  the  aid  of  bool^s  in  a library,  of  di- 
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agnosing  the  malady  of  a patient,  of  analyzing  a chemical  mix- 
ture or  compound;  and  (the  highest  form  under  the  rubric)  of 
making  an  original  contribution  to  learning  or  science  as  the 
result  of  personal  investigation  or  experiment.  Examinations 
are  carried  out  at  oresent  by  means  of  (1)  written  Dapers;  (2) 
oral  examinations;  (3)  practical,  including  in  medicine  clinical 
tests;  (4)  theses;  or  a combination  of  these. 

!i 

In  written  examinations  the  candidates  are,  as  a rule,  sup- 
plied with  a number  of  printed  questions,  of  which  they  must 

■ 

ijanswer  all,  or  a certain  proportion,  within  a given  time, vary- 
ing,  as  a rule,  from  one  and  one-half  hours  to  three  hours,  the 

] 

latter  being  the  duration  most  generally  adopted  for  higher  ex- 
aminations in  England.  Whereas  in  France  and  Germany  the  qUes- 
tions  are  generally  few  in  number  and  require  long  answers, 
showing  constructive  skill  and  mastery  of  the  mother-tongue  on 
the  part  of  the  candidates,  such  "essay -papers"  are  comparative- 
! ly  rare  in  England.  In  many  subjects  the  written  examinations 
test  memory  rather  than  capacity.  It  has  been  suggested  that 
(sets  of  questions  to  be  answered  in  writing  should  as  a rub  be 
divided  into  two  parts;  (i)  a number  of  questions  requiring 
short  answers  and  intended  to  test  the  range  of  the  candidate's 
knowledge;  (ii)  questions  requiring  long  answers,  intended  to 
test  its  depth,  and  the  candidate's  powers  of  co-ordination  and 
reflection.  A necessary  condition  for  the  application  of  the 
second  kind  of  test  is  that  time  should  be  given  for  reflection 
and  rewriting,  say  one-third  or  one-quarter  of  the  whole  time 
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allowed.  A further  distinction  is  important,  especially  in 
such  subjects  as  mathematics  or  foreign  languages,  in  which  it 
is  legitimate  to  ask  what  precise  power  on  the  part  of  a candi- 
date the  passing  of  an  examination  shall  signify.  Owing  to  a 
prevailing  confusion  between  tests  of  memory  and  tests  of  cap- 
acity, the  allowance  for  chance  fairly  applied  to  the  former  is 
apt  to  be  unduly  extended  to  the  latter.  In  applying  tests  of 
memory,  it  may  be  legitimate  to  allow  a candidate  to  pass  who 
answers  correctly  from  30  to  50%  of  the  questions;  3uch  an  al- 
lowance if  applied  to  a test  of  capacity,  such  as  the  perform- 
ance of  a sum  in  addition,  the  solution  of  triangles  by  means 
of  trigonometrical  tables,  or  the  translation  of  an  easy  passage 
from  a foreign  language,  appears  to  be  irrational.  A candidate 
who  obtains  only  50%  of  the  marks  in  performing  such  operations 
cannot  be  regarded  as  being  able  to  perform  them;  and,  if  the 
examination  is  to  be  treated  as  a test  of  his  capacity  to  per- 
jforra  them,  he  should  be  rejected  unless  he  obtains  full  marks, 
less  a certain  allowance  (say  10,  or  at  most  20% ) in  view  of  the 
more  or  less  artificial  conditions  inherent  in  all  examinations. 
Oral . The  oral  examination  is  better  suited  than  the  written  to 
discover  the  range  of  a candidate’s  knowledge;  it  also  serves 
as  a test  of  his  powers  of  expression  in  his  mother-tongue,  or 
‘in  a foreign  language,  and  may  be  used  (as  in  the  examination 
for  entrance  to  the  Osborne  Naval  College)  to  test  the  import- 
ant qualities  (hardly  tested  in  any  other  examination  at  pres- 
ent), readiness  of  wit,  common-sense  and  nerve.  It  may  be  ob- 
jected that  candidates  are  heavily  handicapped  by  nervousness  in 
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I'oral  examination,  but  this  objection  does  not  afford  sufficient 
ground  for  rejecting  the  test,  provided  that  it  is  supplemented 
by  others.  Oral  tests  are  used  almost  invariably  in  medical  ex- 

i 

aminations;  and  there  is  a growing  tendency  to  make  them  compul- 
Isory  in  dealing  with  modern  languages.  Oral  examinations  are 
much  more  used  abroad  than  in  England,  where  the  pupils  during 
their  school  years  receive  but  little  exercise  in  the  art  of  con 
jsecutive  sneaking. 

ii 

Practical  The  laboratory  examination  may  be  used  in  subjects 
'like  physics,  chemistry,  geology,  zoology,  botany,  anatomy,  phys; 
oiogy*  to  test  powers  of  manipulation  and  knowledge  of  experi- 
mental  methods.  In  some  cases  ( e . g . in  certain  honours  examin- 
ations)  the  examination  may  be  prolonged  over  one  or  more  days, 

1 

.'and  may  test  higher  powers  of  investigation.  But  such  posers  caiji 
only  be  fully  tested  by  the  performance  of  original  work,  under 
conditions  difficult  to  fulfill  in  the  examination  room  or  lab- 
oratory. At  the  French  examinations  for  the  prix  de  Rome  the 

j!  candidates  are  required  to  execute  a painting  in  a given  number 

. . 

of  days,  under  strict  supervision  (en  loge) 

|l 

In  medicine  the  clinical  examination  of  a patient  is  a test 
carried  out  under  conditions  more  nearlj/'  approaching  those  of 
actual  work  than  any  other;  and  distinction  in  medical  examina- 
tions is  probably  more  often  followed  by  distinction  in  after 
i life  than  is  the  case  in  other  examinations. 

j 

! Thesis.  For  the  doctor’s  degree  (where  this  is  not  an  honorary 
distinction)  a thesis  or  dissertation  is  generally,  though  not 
{ invariably,  required  in  England.  Of  recent  years  the  thesis  hasi 
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been  introduced  into  lower  examinations;  it  is  required  for  the 
master's  degree  at  London  in  the  case  of  internal  students,  in 
subjects  other  than  mathematics  (1910);  both  at  Oxford  and  London 
the  B. Sc . degree,  and  at  Cambridge  the  B.A.  degree,  may  be  given 
for  research,  although  the  number  of  students  proceeding  to  a 
Idegree  in  this  way  is  at  present  relatively  small.  In  certain 
of  the  honours  B.A.  and  B.  Sc.  examinations  at  Manchester  and 
Liverpool,  candidates  may  take  the  written  portion  of  the  exam- 
ination at  the  end  of  the  second  year's  course  of  study  and  sub- 
mit a dissertation  at  the  end  of  the  third  year.  Theses  are  gent 

erallv  examined  by  two  or  more  specialists. 

j 

5. Competitive  Examinations.-?  he  arrangement  of  students 
In  order  of  merit  led  naturally  to  the  use  of  examinations  not 
only  as  a qualifying  but  also  as  a selective  test,  and  to  the 
offering  of  money  prizes  (including  exhibitions,  scholarships 
and  fellowships)  on  the  results.  In  1854-  selection  by  examina- 
!tion  as  a method  of  appointment  to  costs  in  the  English  public 
^service  was  first  substituted  for  the  patronage  system,  which 
had  caused  grave  dissatisfaction  (see  Macaulay’s  speech  on  the 
subject,  the  Times  of  the  25th  of  June  1853).  The  first  public 
competitive  examination  for  the  Royal  Military  Academy,  Woolwich, 
took  place  in  1855,  and  in  1870  the  principle  of  open  competition 
for  the  Royal  Military  Academy,  Woolwich,  took  place  in  1855, 
and  in  1870  the  principle  of  open  competition  for  the  civil  ser- 
vice was  adopted  as  a general  rule.  (For  further  details  see 
iC IV I L SERVICE.) 
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In  the  Wurttemberg  civil  service  candidates  are  admitted  to 
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a year's  probation  after  passing  a theoretical  examination,  at 
the  conclusion  of  which  they  must  pass  an  examination  of  a more 
practical  character  (A.  Herbert,  Sacrifice  of  Education .... 1889 
p.lll) . 

In  the  award  of  scholarships,  &c.,  it  should  be  definitely 
decided  whether  the  scholarship  is  to  be  awarded  (1)  for  attain- 
ment, in  which  case  the  examination-test  pure  and  simple  may 
suffice,  or  (2)  for  promise,  in  which  case  personal  information 
and  a curriculum  vitae  are  necessary.  To  take  a simple  instance; 
a candidate  partly  educated  in  Germany  may  obtain  more  marks  in 
German  at  a scholarship  examination than  another  who  is  more 
gifted,  but  whose  opportunities  have  been  less;  the  question 
at  once  arises,  are  the  examiners  to  take  the  circumstances  of 
the  candidate  into  account  or  not?  It  is  understood  that  at  the 
colleges  of  the  older  universities  such  circumstances  are  con- 
sidered. It  must  again  be  decided  whether  the  financial  cir- 
cumstancesof  candidates  are  to  be  taken  into  account;  are  schol- 
arships intended  as  prizes,  or  as  a means  of  enabling  poor  stu- 
dents to  obtain  a university  education?  In  some  cases  wealthy 
students  have  been  known  to  return  the  emoluments  of  scholar- 
ships. In  many  universities  of  the  United  States  there  is  a 
definite  understanding  that  emoluments  shall  only  be  accepted 
by  those  needing  them.  It  would  not  be  difficult  to  ask  candi- 
dates to  make  a confidential  declaration  on  this  subject  on  en- 
trance and  to  establish  in  Great  Britain  a tradition  similar  to 
that  of  the  United  States,  and  steps  in  this  direction  have 
been  taken  both  at  Oxford  and  Cambridge  (Lord  Curzon  of  Kedlesttbn, 
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Unlveristy  Reform,  p.86). 

A special  allowance  may  be  made  for  age.  In  certain  schol 
arship  examinations  held  formerly  by  the  London  County  Council 
a percentage  was  added  to  the  marks  of  each  candidate  propor- 
tionate to  the  number  of  months  by  which  his  age  fell  short  of 
the  maximum  age  for  entry.  The  whole  subject  of  entrance  schol 
arships  at  English  schools  and  universities,  and  especially 
their  tendency  to  produce  premature  specialization,  has  recently 
been  much  discussed. 

6.  The  Organization  and  Conduct  of  Examinations . -The  organ 
ization  and  conduct  of  examinations , in  such  a way  that  each 
candidate  shall  be  treated  in  precisely  the  same  way  as  every 
other  candidate,  is  a complex  matter,  especially  v/here  several 
thousand  candidates  are  concerned.  The  greatest  precautions 
must  be  taken  to  insure  the  secrecy  of  the  examination  papers 
before  the  examination,  and  the  effective  isolation  of  individ- 
ual candidates  during  the  examination.  The  supervision  should 
be  adequate  to  remove  all  temptationto  copying.  The  hygienic 
conditions  should  be  such  as  to  reduce  the  strain  to  a minimum. 
The  question  of  the  mental  fatigue  produced  by  examinations  has 
been  studied  by  certain  G-erman  observers,  but  has  not  yet  been 
fully  investigated. 

7.  Marking.  Classification  and  Errors  of  Detail. -In  applying 
a single  test  in  a qualifying  examinationit  would  be  sufficient 
to  mark  candidates  as  passing  or  failing.  But  examinations 
consist  as  a rule  of  a number  of  tests,  each  one  of  which  is 
complex;  and  a mark  is  recorded  in  respect  of  each  test  or  por- 
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tion  of  a test  in  order  to  enable  the  examining  body  to  estimate 
the  performance,  consideredas  a whole,  of  the  candidate.  At 
Oxford  the  marks  are  not  numerical,  but  the  papers  are  judged 
as  of  this  or  that  supposed  ’’class,"  and  various  degrees  of  mer- 
it are  indicated  by  the  symbols^*  -’1  to  which  the  signs  > or  — 
may  be  prefixed,  according  as  they  are  above  or  below  a certain 
standard  within  each  class.  At  Cambridge,  numerical  marks  are 
used.  The  advantage  of  numerical  marks  is  that  they  are  more 
easily  manipulated  than  symbols;  the  disadvantage,  that  they 
produce  the  false  impression  that  merit  can  be  estimated  with 
mathematical  accuracy.  Professor  E.  Y.  Edgeworth,  in  two  papers 
on  "The  Statistics  of  Examinations"  and  the  "Element  of  Chance 
in  Competitive  Examinations"  (Journal  of  the  Royal  Statistical 
Society . 1888  and  1890),  has  dealt  with  the  subject,  although 
on  somewhat  limited  lines.  His  investigations  show  clearly 
that  with  candidates  near  the  border-line  of  failure,  which 
must  necessarily  be  fixed  at  a given  point  (subject  to  certain 
allowances  where  more  than  one  subject  is  considered),  the  ele- 
ment of  chance  necessarily  enters  largely  into  the  question  of 
pass  and  failure.  The  fact  may  be  stated  in  this  way : -the  gen- 
eral efficiency  of  the  test  being  granted,  it  is  true  to  say 
that  the  large  majority  of  those  who  passan  examination  will  be 
superior  in  efficiency  to  those  who  fail;  but  a few  of  those 
who  fail  may  be  superior  to  a few  of  those  who  pass.  These 
errors  are  not  peculiar  to  the  examination  system,  they  are  in- 
herent in  all  human  judgments.  It  is  necessary  to  allow  for 
them  in  considering  the  failure  of  an  individual  candidate  as 
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an  index  inefficiency. 

The  element  of  chance,  which  prevails  in  the  region  on 
either  side  of  the  border  between  pass  and  failure,  obviously 
prevails  equally  on  either  side  of  the  border  between  "classes," 
where  candidates  are  classified;  it  has  been  suggested  by  Dr. 
Schuster  that  numerical  order  should  accompany  classification 
so  as  to  avoid  the  creation  of  an  artificial  gap  between  the 

l 

last  candidate  in  one  class  and  the  highest  in  the  next. 
{Edgeworth's  objection  to  such  an  argument  is  that  the  number  of 
uncertainties  is  far  less  when  candidates  are  classed  than  when 
they  are  placed  in  ostensible  order  of  merit. 

The  difficulties  of  comparison  of  marks  are  further  compli- 

Jjcated  when  students  take  different  subjects  and  it  is  necessary 

|! 

ito  compare  their  merit  by  means  of  marks  allotted  by  different 

(examiners  and  added  together.  In  a pass  examination  the  ques- 

1 

jtion  has  to  be  considered  how  far,  if  at  all,  excellence  in  one 

I 

{'subject  shall  compensate  for  deficiency  in  another,  a question 
which  is  indeterminate  until  the  precise  object  of  the  whole  ex- 
amination is  formulated.  In  the  competitive  examination  for  the 
Indian  civil  service,  places  are  allotted  on  the  aggregate  of 
marks  obtained  in  a number  of  subjects  selected  by  the  candidates 
from  a list  of  thirty -two.  The  successful  candidates  are  com- 
pared a year  later  on  the  results  of  another  examination  in 
which  there  is  again  a choice,  though  a much  more  limited  one. 

f 

;’The  order  of  merit  in  the  two  examinations  is,  as  a rule,  very 
different. 

Two  futher  points  may  be  noted.  An  examiner  may  have  under- 
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estimated  the  time  required  to  answer  the  questions  which  he  has 
set;  this  will  be  obvious  if  with  a large  number  of  candidates 
|!(say  300  or  400)  none  approaches  the  maximum  mark.  In  this  case 
i;the  maximum  should  be  reduced.  Again,  it  is  gererally  recognize! 
to  be  undesirable  to  give  marks  for  a smattering.  In  order  to 
!avoid  this  various  devices  are  adopted.  The  simplest  is  to  awartf 
a prooortion  of  marks  (say  10  to  15,  or  even  20%)  for "general 
impression."  In  some  examinations,  unless  say  20%  or  more  marks 
lare  obtained  for  a particular  subject,  no  credit  is  given  for 
the  paper  in  that  subject.  Latham  (The  Action  of  Examinations, 
l877,p.490)  describes  other  numerical  adjustments  used  to  meet 
this  difficulty,  especially  that  used,  in  English  civil  service 
examinations  are  reduced  so  as  to  conform  to  a certain  symmetri- 
cal "frequency-curve,"  of  which  the  abscissae  represent  percent- 
ages of  marks  between  definite  limits  and  the  ordinates  the  num- 
ber of  candidates  obtaining  marks  between  those  limits*  C.  E. 
Eawsitt  (The  Education  of  the  Examiner.  Royal  Philosophical 

Society  of  Glasgow,  1905)  shows  that  frequency -curves  deduced 
1 

ifrom  actual  investigation  of  class-marks  are  not  symmetrical, 

• 

but  have  two  maxima  corresponding  to  the  performance  of  "non- 
workers" and  of  "workers."  In  pass  examinations  of  a well-known 
character  there  is  a maximum  just  beyond  the  pass  mark,  this  be- 
ing the  point  of  efficiency  at  which  many  students  aim. 

0 . The  Object  and  Efficiency  of  Examinations,  and  their  In- 
direct Effects. -In  order  to  estimate  the  efficiency  of  an  exam- 
ination as  a test,  the  precise  question  should  be  asked  in  each 

I 

'case--what  is  it  intended  to  test?  Much  of  the  evil  attributed 
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to,  and  resulting  from,  examinations  is  due  to  the  fact  that 
this  question  has  not  been  definitely  put,  and  that  a test 
legitimate  for  certain  purposes  has  been  used  for  others  to 
which  it  is  unsuited.  Examinations  are  suited  in  the  first 
instance  for  the  purpose  for  which  they  were  originally  designed 
in  medieval  univer sities-the  test  of  technical  and  professional 
capacity;  it  has  never  been  proposed  to  abolish  qualifying  ex- 
aminations for  doctors,  pharmaceutical  chemists,  &c. ; the  tests 
applied  are  (or  should  be)  direct  tests  of  capacity  carried  out 
under  conditions  as  nearly  as  possible  like  those  of  actual  prab 
tice.  If  a student  can  auscultate  correctly,  or  make  up  a pre- 
scription, at  an  examination,  he  will  in  all  probability  be 
able  to  do  so  in  other  circumstances. 

Examinations  as  tests  of  the  knowledge  of  isolated  facts 
are  necessarily  of  relatively  small  value,  because  the  memory 
of  such  facts  is  transient;  and  memorization  of  a large  number 
of  facts  for  examination  purposes  is  generally  admitted  to  be 
specially  transient;  the  "knowledge-test,"  considered  apart 
from  a test  of  capacity,  is  in  fact  not  a test  of  permanent 
knowledge,  but  of  the  power  of  retaining  facts  for  a length 
of  time  which  it  is  impossible  to  estimate  and  which  with  some 
candidates  extends  over  a few  weeks  only.  When  used  as  tests 
of  "general  culture,"  examinations,  in  the  view  of  Paulsen, 
based  on  a study  of  German  education,  not  only  fail  in  their 
purpose,  but  tend  to  destroy  the  faculties  which  it  is  desired 
to  develope  (G-esch ichte  des  gelehrten  Unterrichts,  ii.  684  et 
weq.);  to  prepare  ready  answers  to  the  numberless  questions 
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which  an  examiner  may  ask  on  a large  variety  of  subjects  is  to 
paralyse  the  natural  and  free  activity  of  the  mind  (cf.A.C. 
Benson  on  the  results  of  English  secondary  classical  education, 
From  a College  Window^3rd  ed.,  1906,  pp.  15^-177).  If  pushed 
to  its  logical  conclusion  the  view  of  Paulsen  must,  it  is  ad- 
' mitted,  lead  to  the  complete  abandonment  of  examinations  of 
tests  of  "knowlege"  as  distinguished  from  direct  tests  of  cap- 
acity. Thus  isolated  questions  on  details  of  grammar  would 
' disappear  from  papers  on  the  mother-tongue  and  on  foreign  lang- 
uages, in  which  the  test  would  consist  mainly  or  entirely  of 

composition  and  translation.  Erudition  would  be  tested  by  the 

i 

power  of  writing,  at  leisure,  a dissertation  on  some  subject 
selected  by  the  examiners  or  the  candidate  or,  in  the  case  of 
a teacher,  by  the  delivery  of  a lecture  on  the  subject.  At 
the  French  agr&gation  candidates  are  given  twenty-four  hours 
for  the  preparation  of  a lecture  of  this  kind.  Such  examination 
would  test  the  ’’skill  in  the  manipulation  of  facts  which  is 
the  true  sign  of  a trained  intelligence"  (cf.  K.  Pearson,  "The 
Function  of  Science  in  the  Modern  State,"  Encv . Brit . 10th  ed. 
xxxil.  Prefatory  essay).  They  might  possibly  be  supplemented 
by  easy  oral  examinations  to  test  both  range  of  knowledge  and 
! readiness  of  mind.  But  in  the  case  of  a pupil  who  had  passed 
through  a good  secondary  school  it  would  be  as  safe  to  rely  for 

| 

supplementary  information  under  this  head  on  the  testimony  of 
his  teachers,  as  it  is  to  rely  on  their  evidence  with  regard 
, to  the  fundamental  and  all-important  element  on  which  no  exam- 
i ination  supplies  direct  information-  personal  character. 

j 
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The  main  arguments  of  those  opposed  to  the  examination  sys- 
tem may  he  summarized  as  follows:  (i.)  Examinations  tend  to  des- 
troy natural  interests  and  exclude  from  the  attention  of  the  pup 
i 1 all  matters  outside  the  purview  of  the  examination  (they 
would  not  do  so  if  examinations  were  so  limited  in  character 

|i 

that  preparation  therefor  could  absorb  only  a fraction  of  the 
ilpupils*  time);  (ii.)  they  tend  to  cultivate  a personal  judgment 
where  no  personal  basis  of  judgment  is  possible  (the  argument, 
directed  mainly  against  the  Oxford  essay  system,  applies  not  to 
examinations  in  general,  but  to  the  character  of  the  subjects 
set  for  essays);  (iii#)  competitive  examinations  on  the  home 
|and  Indian  civil  services  scheme  tend  to  diffuse  mental  energy 
over  too  many  subjects  (but  see  (xviii.)  below);  (iv.)  examina- 
tions, especially  competitive  examinations,  tend  to  become  more 
and  more  difficult,  difficulty  being  confused  with  efficiency  - 
this  has  shown  itself  with  the  Cambridge  mathematical  tripos,  in 
which  for  years  questions  of  increasing  difficulty  were  set  on 

I 

'relatively  unimportant  subjects,  until  the  examination  was  re- 
formed (reply:  all  examinations  should  be  overhauled  periodi- 
cally); (v.)  they  tend  to  paralyse  the  powers  of  exposition,  all 
statements  of  knowledge  being  thrown  into  a form  suitable,  not 
for  an  uninstructed  person,  but  for  one  who  already  possesses 
it,  the  examiner  (this  tendency  should  be  counteracted  by  defi- 

nite  training  in  composition);  (vi.)  the  sample  of  knowledge 
f 

and  capacity  yielded  at  an  examination  is  frequently  not  a fair 
| sample;  it  is  liable  to  extreme  variations  in  a favorable  sense, 
if  the  candidate  happens  to  have  prepared  the  precise  questions 
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asked;  in  an  unfavourable  sense,  if  the  candidate  is  suffering 
from  misfortune  or  from  accidental  ill-health,  the  latter,  owing 
to  the  periodic  function,  occuring  much  more  frequently  in  the 
case  of  women  than  of  men- (the  reform  of  examination  methods 
may  remove  to  a great  extent  the  element  of  chance  in  questions 
set;  in  a competitive  examination  it  is  impossible  to  allow  for 
ill-health;  in  a qualifying  examination  it  is  difficult  to  make 
any  allowance  unless  the  examination  is  definitely  conducted  in 
whole  or  in  part  by  the  teachers,  and  the  past  record  of  the 
candidate  is  taken  into  account  (cf.  Paulsen,  The  G-erman  Univer- 
sities, pp. 34-4-345) ; (vii,  ) examinations  of  several  hundred  can- 
didates at  a time  cannot  be  rationally  conducted  so  as  to  be 
equally  fair  to  the  individuality  of  all  candidates;  the  indi- 
vidual test  is  the  only  complete  one  (it  is  admitted  that  exam- 
inations on  a large  scale  necessarily  involve  a margin  of  error; 
but  this  error  may  be  reduced  to  a minimum,  especially  by  a com- 
bination of  oral  and  practical  with  written  work);  (viii.)  the 
multiplicity  of  school  examination  required  for  different  reason 
produces  confusion  in  our  secondary  education  (there  is  a grow- 
ing tendency  to  admit  equivalence  of  "school-leaving"  and  en- 
trance examinations;  thus  entrance  examinations  of  Oxford, 
Cambridge  and  London,  and  the  Northern  Universities  Joint  Board 
are  interchangeable  under  certain  conditions);  (ix.)  the  multi- 
plicity of  examinations  tends  to  "underselling"  (the  success  of 
the  London  examinations  in  medicine  proves  that  a high  standard 
attracts  candidates  as  well  as  a low  one;  possibly  intermediate 
standards  may  be  killed  in  the  competition;  it  is  by  no  means 
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obvious  that  a uniform  system  of  examinations  would  conduce  to 
efficiency);  (x. ) examinations  produce  physical  damage  to  health, 
especially  in  the  case  of  women- students  (on  the  point  more 
statistical  evidence  is  needed;  see,  however  Engelmann  quoted 
by  G.  Stanley  Hall,  Adolescence,  1905,  ii.588  et  seq. ) ; (xi.) 
examinations  have  in  England  mechanically  cast  the  education  of 
women  into  the  same  mould  as  that  of  men,  without  reference  to 
the  different  social  functions  of  the  two  sexes  (the  remedy  is 
obvious);  (xii.)  it  is  unjustifiable  to  give  a man  a university 
position  on  the  results  of  his  performance  in  the  examination 
room,  a practice  common  in  England  though  almost  unknown  on  the 
continent;  a just  estimate  of  a man's  powers  in  research  or  for 
teaching  can  only  be  properly  based  on  his  performance.  The 
present  system  merely  leads  to  the  transmission  of  the  sterile 
art  of  passing  examinations.  (At  Oxford  and  Cambridge  many 
felloT/ships  are  now  awarded  on  the  results  of  examination;  it 
is  sometimes  stated,  in  defence  of  this  system,  that  young  men 
cannot  be  expected  to  carry  out  research  in  classics  or  phil- 
osophy . ) 

On  the  other  hand,  the  defenders  of  examinations  reply 
that  (xiii.)  examinations  are  necessary  in  order  to  test  the 
efficiency  of  schools  to  which  grants  of  public  money  are  given 
(this  argument  has  become  somewhat  out  of  date  owing  to  the  re- 
cent substitution  of  "inspection"  for  examination  as  a test  of 
the  efficiency  of  schools;  a combination  on  inspection  and  exam 
ination  is  also  sometimes  used);  (xiv.  ) they  serve  as  a necess- 
ary incentive  to  steady  and  concentrated  work  (the  reply  made 
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to  this  is  that  the  incentive  is  a bad  one,  and  that  with  effi- 
cient teachers  it  is  unnecessary);  (xv.)  they  show  both  student 
and  teacher  where  they  have  failed  (unnecessary  for  efficient 
teachers);  (xvi.)  though  possibly  harmful  to  the  highest  class 
of  men,  they  are  good  for  the  mass  (reply:  no  system  which  dam- 

ages the  highest  class  of  men  is  tolerable);  (xvii.)  they  are  in 
dispensable  as  an  impartial  means  of  selecting  men  for  the  civil 
service;  (xviii.)  in  a difficult  examination  like  the  first 
class  civil  service  examination  the  qualities  of  quickness  of 
comprehension,  industry,  concentration,  power  of  rapidly  passing 
from  one  subject  to  another,  good  health,  are  necessary  for 
success, (the  Oxford  commissioners  of  1852  reported  that  "the  ex- 
aminations have  become  the  chief  instruments  not  only  for  test- 
ing the  proficiency  of  the  students  but  also  for  stimulation 
and  directing  the  studies  of  the  place".  Report . p.6l)  though 
not  tested  directly,  and  these  qualities  are  valuable  in  any 
kind  of  work  (this  appears  to  be  incontrovertible);  (xix.)  exam- 
ination records  sho w that  success  in  examinations  is  generally 
followed  by  success  in  after-life,  and  the  test  is  therefore 
efficient  (it  does  not  follow  that  certain  rejected  candidates 
may  not  be  extremely  efficient);  (xx. ) as  a plea  for  purely 
"external  examinations,"  teachers  cannot  be  trusted  to  be  im- 
partial and  it  is  better  for  a boy  to  "cram"than  to  curry  favour 
with  his  teacher  (Latham). 

The  brief  comments  in  brackets,  appended  above  to  the  argu-i 
ments,  merely  indicate  v/hat  has  been  said  or  can  be  said  on  the 
other  side.  It  can  scarcely  be  doubted  that  in  spite  of  the 
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powerful  objections  that  have  been  advanced  against  examination 
they  are,  in  the  view  of  the  majority  of  English  people,  an  in- 
dispensable element  in  the  social  organization  of  a highly  spe- 
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cialized  democratic  state,  which  prefers  to  trust  nearly  all  de- 
cisions to  committees  rather  than  to  individuals.  But  in  view 
of  the  extreme  importance  of  the  matter,  and  especially  of  the 
evidence  that,  for  some  cause  or  other  (which  may  or  may  not  be 
the  examination  system),  intellectual  interest  and  initiative 
seem  to  diminish  in  many  cases  very  markedly  during  school  and 
college  life  in  England,  the  v/hole  subject  seems  to  call  for  a 
searching  and  impartial  inquiry. 

Encyclopaedia  Britannica  11th  Ed.  vii  49 

Sources  of  Information. -The  works  mentioned  above,  and  T.  D. 
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Ireland  (2nd  ed.,  Oxford,  1903);  W . W.  Rouse  Ball,  Origin  and 
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1400  (Berlin,  1885);  F.  Y.  Edgeworth,  "The  Statistics  of  Ex^mina 
jtions,"  and  "The  Element  of  Chance  in  Competitive  Examinations,  1 
Journal  of  the  Statistical  Society,  1888  and  1890  respectively; 
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Third  Report  of  the  Royal  Commissioners  on  Scientific  Instruc tioiji 
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Private  information  from  Professor  M.  E.  Sadler  and  Mr.  A.  E. 

Twentyma n.  (P.  J.  H.;  A.  Wn.) 

The  following  is  copied  verbatim  from  Encyclopaedia  Britannica 
Ninth  Edition  Vol.  Vlll  New  York:  Charles  Scribner'  s Sons. 


EXAMINATIONS.  Examinations  have  lately  come  very  widely  into 
use,  and  call  for  consideration  at  once  as  educational  appli- 
ances and  as  tests  of  proficiency.  Something  answering  to  exam- 
inations must  enter  into  all  effectual  instruction;  for  in  order 
that  the  pupil  may  gain  solid  advantage  it  is  not  enough  that 
what  he  ought  to  know  should  be  put  before  him  - §,s  by  giving 
him  a book,  or  by  making  him  listen  to  lectures  - but  we  must  al 
so  see  that  he  gets  hold  of  it  and  understands  it  aright;  this 
is  the  function  of  examinations  as  appliances  for  education. 

They  have,  however,  another  use,  that  of  tests  or  instruments 
for  selection,  and  this  purpose  may  clash  v/ith  the  educational 
purpose.  But  though  the  examiners  may  have  one  purpose  prima- 
rily in  view,  and  may  lay  down  their  scheme  with  special  refer- 
ence to  it,  we  must  bear  in  mind  that  the  examination  must  act 
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in  both  ways  at  once.  Some  sort  of  advantage  must  attend  on  suc- 
cess, or  else  candidates  will  not  work  for  it;  and,  on  the  other 
hand,  though  an  examination  may  only  be  intended  to  sift  out  the 
ablest,  and  pains  may  be  taken  to  avoid  giving  any  advantage  to 

i 

a particular  sort  of  instruction,  still  it  will  be  found  that 
some  particular  course  is  most  productive  of  marks,  and  this 
will  come  into  favour. 

The  few  notices  which  we  find  of  examinations  in  old  times 
relate  to  tests  of  qualifications  for  professions  or  crafts.  We 
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gather  from  notices  of  contests  between  the  universities  and  the 
; medical  corporations  in  London  that  students  had  to  pass  an  ex- 
amination, after  going  through  their  apprenticeship,  before 
being  allowed  to  practise.  But  we  never  find  that  an  examination 
was  the  sole  test;  it  was  always  attached  to  a prescribed  course 

of  study  and  service.  The  foundation  deeds  of  old  endowed  schools 

i; 

sometimes  contain  a provision  for  an  examination;  the  object  of 
this  seems  to  have  been  rather  to  ascertain  that  the  teaching 

' 

was  satisfactory  than  to  classify  the  boys,  though  sometimes 

it 

prizes  and  emoluments  were  awarded  by  the  examiners. 

1 

University  examinations  are  found  to  take  their  origin  from 
the  "disputations”  which  appear  very  early  in  the  history  of 
universities.  Dialectical  discussion  had  entered  largely  into 
the  higher  education  in  classical  times,  and  when  the  university 
of  Bologna  was  incorporated  as  a school  of  law  by  the  emperor 
;j  Frederick  I.  in  1158,  disputations  soon  came  into  use  as  exer- 

cises  for  degrees.  The  university  of  Paris,  which  was  founded 

. 

soon  after,  and  which  was  a school  of  theology  and  of  arts,  ad- 
opted the  same  course;  and  the  forms  of  these  exercises  for 
degrees  have  survived  to  the  present  time  in  Germany,  and  did 
not  disappear  in  England  until  i860. 

| A student  who  aimed  at  a degree,  which  formerly  only  the 
more  distinguished  did,  acted  three  times  as  opponent  to  other 
candidates,  and  was  in  time  admitted  to  keep  his  "Act".  This 
performance  began  by  his  reading  a Latin  thesis,  in  which  he 
maintained  some  position  in  disputation  against  a doctor  in  the 
faculty,  as  well  as  the  above  named  opponents,  and,  in  fact. 
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against  all  comers.  The  debate  was  carried  on  in  syllogistic 
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form:  the  presiding  doctor  eventually  summed  up  the  controversy, 
and  usually  passed  a compliment  on  the  disputant,  which  was  the 
earliest  form  of  university  honours. 

Academical  degrees,  in  their  origin,  implied  a title  to 
teach,  as  is  seen  in  the  names  of  Doctor  and  Master.  The  notion] 
of  a university  degree  as  a criterion  of  general  cultivation  is 
comparatively  recent:  the  B.  A*  or  first  degree,  which  is  now 
so  important,  was  not  known  in  the  earliest  times,  and  is  not 
} even  now  granted  in  the  G-erman  universities.  The  disputations 
took  wonderful  hold  of  the  popular  mind  in  the  Middle  Ages.  It 
may  be  supposed  that  students  looked  more  to  points  that  gave  a: 
opening  for  attack,  or  that  might  be  ingeniouslj/-  defended,  than 
to  the  truth  of  the  matter;  and  as  u,he  question  would  be  settlecj. 
by  an  appeal  to  the  Bible  or  Aristotle,  a habit  of  looking  to 
;i  authority  was  engendered.  We  may  catch  sight  of  analogous  evils 
in  the  examination  system;  for  under  this  the  points  that  are 
most  likely  to  yield  questions  are  the  most  studied.  The  two 
plans  are  only  different  ways  in  which  the  student  may  make  a 
display  of  the  powers  or  the  knowledge  he  has  acquired.  We  may 
observe  that  disputations  bring  out  “powers ”,  such  as  ease  of 
expression  in  Latin,  quickness  in  logical  fence,  and  fertility 
of  resource,  more  adapted  for  “Arts'1  than  for  sciences.... 

The  most  important  change  in  an  educational  direction  was 

effected  by  the  influence  of  Dr.  Whewell  in  1848.  He  Introduced 

ii 

• a compulsory  examination  of  adequate  length  in  the  elementary 
subjects,  especially  elementary  natural  philosophy;  this  checked 
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the  practice  of  reading  "scraps"  of  the  higher  subjects.  The 
old  educational  party  aimed  at  turning  out  men  in  the  most  eff- 
ective condition  for  the  ordinary  struggles  of  life,  while  a 
later  party  sought  to  turn  out  mathematicians  to  supply  the  de- 
mands of  the  scientific  world.... 

It  is  found  that  some  branches  of  study  are  better  suited 
for  examination  than  others.... 

Examinations,  of  course,  tell  us  little  directly  about 
moral  qualities;  industry,  indeed,  they  reward,  but  the  work 
produced  may  have  been  done  under  the  strong  incentive  of  eager- 
ness for  success,  or  under  compulsion,  or  in  the  absence  of 
temptation,  and  under  other  circumstances  the  candidate’s  zeal 
may  flag.  Energy  and  tastes  go  far  to  make  a man  what  he  is, 
and  of  these  examinations  tell  us  nothing.  A course  of  exam- 
inations tells  something  more  as  to  steadiness  of  purpose  and 
growth  of  mind  than  a single  one,  and  a person  who  follows  up 
an  unusual  kind  of  study  - such  as  till  lately  natural  science 
was  - has  probably  a genuine  taste  for  it.... 

Examinations  are  effective  in  three  principal  ways  as  re- 
gards education.  First,  they  act  as  stimulants,  partly  by  hold- 
ing out  the  prospect  of  advantages  of  some  sort,  and  partly  by 
appealing  to  the  combative  spirit  in  human  nature  and  the  desire; 
to  excel ... .Hence  competitive  examinations  should  not  be  often 
repeated;  a single  comprehensive  one  at  the  end  of  a long  course1 
may  do  good,  but  it  must  not  be  kept  always  immediately  in  view. 

Secondly,  examinations  serve  as  guides.... 

Thirdly,  examinations  oblige  a person  to  be  able  to  produce 
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his  knowledge,  and  encourage  him  to  bring  it  out  in  a terse  and 
lucid  style .... 

But  examinations,  even  when  well  conducted,  have  ill  as 

I1  well  as  good  effects.  They  destroy  spontaneity.  Nine  young 

| 

people  out  of  ten  may  quite  rightly  be  made  to  move  in  a good 
"regulation  groove",  but  the  tenth  would  be  better  for  having 
! room  to  expatiate.... 

Examinations,  though  good  for  boys,  are  bad  for  men.  Those 
j;  which  deal  with  general  education  should  not  be  continued  beyonc. 

!|  the  age  of  22.  Professional  examinations,  or  examinations  in  thie 
; highest  parts  of  science,  intended  for  those  who  mean  to  give 
their  lives  to  study,  must  come  later,  but  should  be  as  little 
competitive  as  possible.... 

Now  we  come  to  Government  competitive  examinations,  such  as 
i!  those  for  the  army  and  civil  service.  The  object  of  the  system 
ji  was  twofold.  First  of  all  it  was  desired  to  get  rid  of  patron- 
age, with  the  solicitation  and  trouble  attending  it,  and,  sec- 
ondly, to  secure  the  ablest  men  which  the  situations  can  com- 
mand. . . . 

The  next  class  to  be  considered  are  "pass  examinations". 


j These  are  important  from  the  large  number  of  men  they  affect. 

By  a pass  examination  we  mean  one  in  which  the  leading  object  is 
to  ensure  a certain  standard....  The  objects  of  a pass  examin- 
ation are  to  sift  out  incapacity,  and  to  ascertain  that  the  can- 
j didates  have  gone  through  a certain  process  of  education.  The 

I- 

!.  pass  examinations  of  universities,  both  in  England  and  in  France, 
! were  until  lately  framed  on  a wrong  principle.  It  was  thought 
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that  the  examinations  should  comprise  a specimen  of  every  kind 
of  knowledge  that  an  educated  man  should  possess.  If  the  grad- 
uate should  prove  ignorant  of  any  such  branch,  the  university, 
it  was  thought,  could  absolve  itself  from  responsibility  by  show- 
ing that  he  had  known  it  at  one  time.  Now,  however,  we  recognizje 
the  fact  that  these  scraps  of  knowledge  soon  disappear.  The 
portion  of  chemistry  or  history  which  the  candidate  has  passed 
in  is  often  only  so  much  "book0  learnt  almost  by  heart;  with 
those  who  do  really  well  the  case  is  different.... 

Essays  may  be  used  in  examinations  in  two  ways.  Subjects 
of  a general  nature,  like  a maxim  or  topic  of  the  day,  may  be 
proposed,  in  which  case  readiness  and  fertility  of  ideas  are 
tested,  but  a kind  of  superficiality  and  glibness  is  engendered; 
or  the  student  may  be  required  to  write  on  some  subject  belonging 
to  his  course.  The  classical  student,  for  instance,  might  write 
on  a point  of  Greek  history.  A dissertation  written  at  leisure 
is  an  excellent  means  of  judging  of  qualifications,  and  may  be 
used  for  those  who  are  past  the  proper  age  for  examination.... 

Out  of  1000  young  men  who  come  to  a university  with  a view 
of  taking  a degree,  we  find  from  experience  that,  roughly  speak- 
ing, the  following  proportions  will  hold  good:  -250  7/ill  have 
both  good  abilities  and  the  requisite  power  of  will,  and  will 
take  creditable  honours:  about  200  more  will  be  comparatively 
weak  in  one  or  other  of  these  qualifications,  but  may  still  get 
a place  in  an  honour  school  or  tripos;  the  next  150  will  be  the 
more  vigorous  pass  men,  who  will  show  intelligence  in  subjects 
of  but  moderate  difficulty,  will  enter  keenly  into  the  life  of 
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the  place,  and  will  pass  their  examinations  respectably;  200 

more  will  pass  without  failure;  the  100  that  follow  will  meet 
with  failures  more  or  less  frequently;  and  the  remaining  100 
will  never  pass  any  university  examination  at  all.  Some  of  these 
last  instances  may  almost  be  regarded  as  cases  of  disease,  ari- 
sing from  infirmity  of  will  or  the  want  of  the  power  to  fix  the 
attention.  Neglect  of  the  early  acquisition  of  good  mental  hab- 
its  is  the  cause  of  many  failures,  A youth  may  be  rejected  once 

!j 

; from  love  of  amusement  or  from  underrating  the  examination,  but 
jj  he  does  not  fail  again  if  he  can  help  it.  A second  failure  shows 
moral  or  intellectual  incapacity. 

On  this  subject  see  - "Remarks  on  State  of  Education  at  Cam- 
j bridge,"  in  Dr.  John  J ebb's  works,  1774-  (here  we  find  the  first 
plan  for  examining  the  pass  men);  Peacock,  On  the  Statutes  of 
the  University  of  Cambridge,  185^  (in  the  latter  see  the  evi- 
dence of  Dr.  Philnott,  Prof.  Stokes,  Dr.  Merivale,  Mr.  R.  Leslie 
Ellis,  and  Mr.  W.  Hopkins);  Suggestions  on  Academical  Organlza- 
tion,  Mark  Pattison,  B.  D.  (referring  to  Oxford);  L.  Wiese, 

G-erman  Letters  on  English  Education,  translated  by  L.  Schmitz, 
1877;  Education  in  Oxford:  its  methods,  its  aids  and  its  reward^. 


James  E.  Thorold  Rogers;  Conflict  of  Studies.  I.  Todhunter,  F. 

R.  S.,  1873;  Higher  Schools  and  Universities  in  Germany . M. 
Arnold,  1874-;  On  the  Action  of  Examinations.  H.  Latham,  1877; 
Report  to  the  French  Government  on  Education  in  England,  by  M. 
Demogeot  and  M.  Montucci,  1870;  Third  Report  of  Royal  CommlsslonL 


ers  on  Scientific  Instruction,  1873;  M.  Burrows,  Pass  and  Class. 
Oxford,  1873;  Student's  Guide  to  the  University  of  Cambridge. 
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1874;  Twentieth  Report  of  Civil  Service  Commissioners,  1876. 
PERIODICALS.  -Mind,  No.  1,  1873,  "Philosophy  at  Oxford",  Mark 
Pattlson,  B.  D. ; Fortnightly  Review.  June  1875,  "The  Examination 
System  at  the  Universities",  A.  H.  Sayce;  Contemporary  Review. 
April  1876,  "idle  Fellowships",  H.  Sedgwick,  and  November  1877, 
"The  Civil  Service  Examination  Scheme  in  relation  to  Sciences 
and  Languages",  Alex.  Bain,  LL.D.;  Nineteenth  Century.  April 
1878,  "The  Good  and  Evil  Examination",  Canon  Barry;  Quarterly 
Journal  of  Education.  April  and  July  1872,  "On  the  Leaving  Ex- 
aminations of  Prussia",  by  W • C.  Perry;  Macmillan1  s Magazine. 
June  1877,  "On  German  Schools",  W.  C*  Perry,  and  March  1878, 
"German  Views  of  Oxford  and  Cambridge". 

Copied  verbatim  from  THE  METHODOLOGY  OF  ED.  RESEARCH  BY  GOOD- 
; BARR-SCATES . 

Perhaps  the  commonest  example  of  normative-survey  research 
in  education  is  survey  testing.  By  survey  testing  is  meant  sim- 
ply  the  testing  of  a group  of  children  (or  adults)  to  ascertain 

1! 

the  prevailing  condition  with  respect  to  the  traits  measured  by 

t 

; the  test.  A teacher  may  give  tests  to  the  pupils  in  her  class 

I 

to  discover  the  general  level  of  the  class  performance.  Sirail- 
ij  arly,  tests  may  be  given  to  the  pupils  in  a school  building,  in 
a city,  county,  state,  group  of  states,  or  larger  area,  and  some 
testing  surveys  have  been  international.  The  primary  purpose 
of  such  testing  is  not  to  reveal  detailed  facts  about  any  par- 
ticular person  individually,  as  in  the  case  study,  but  rather 
to  indicate  the  prevailing  conditions  throughout  the  group.  It 
! is  true  that  diagnostic  and  prognostic  uses  of  tests  emphasize 
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study  of  the  performances  of  individuals.  To  be  considered  re- 
search, survey  testing,  of  course,  must  be  conducted  with  refer^- 
ence  to  some  clearly  defined  problem,  such  as  the  common  errors 
of  pupils  in  a particular  school  subject  at  a given  grade  level. 

In  discussing  survey  testing,  various  uses  will  be  des- 
cribed without  thought  of  suggesting  that  these  are  normally  un- 
dertaken as  research  projects.  These  uses  are  mentioned  to  brin|g 
out  the  breadth  of  the  applications  of  survey  testing,  and  to 
suggest  the  wide  field  in  which  research  may  be  undertaken.  The 
student  who  is  contemplating  research  in  this  area  may  choose 
any  suitable  aspect  of  the  field  for  investigation,  including 
practical  use  as  a data-collecting  instrument  in  seeking  an  an- 
swer to  some  significant  question,  or  actual  study  of  the  tests 
themselves  (characteristics,  construction,  or  method  of  admin- 
istering). In  addition  to  these  uses  of  survey  testing,  one  may 
employ  tests  to  furnish  measurements  for  some  other  method  of 
research,  such  as  experimental  research. 

Achievement  testing.  It  is  now  somewhat  common  for  achieve 
ment  tests  to  be  given  to  entire  school  systems  by  some  central 
agency,  such  as  a bureau  of  research  in  the  superintendant ' s 
office.  Intelligence  tests  are  frequently  given  by  the  same 
agency.  A number  of  the  larger  school  systems  are  constructing 
achievement  tests  of  their  own,  based  upon  the  courses  of  study 
which  have  been  adopted  for  that  particular  system.  The  achievei- 
ment-testing  program  of  a central  bureau  may  cover  the  same  sub-| 
jects  and  the  same  grades  year  after  year,  or  variation  from 
year  to  year  may  be  provided  in  subjects,  grades,  or  tests.... 
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Achievement  testing  is  called  for  in  many  different  kinds  of  re- 
search. 

Testing  for  appraisal.  In  the  earlier  testing  literature, 

I and  even  in  that  of  more  recent  date,  it  has  been  stated  that 
achievement  tests  could  be  used  to  appraise  the  work  of  teach- 
ers, of  principals,  and  even  of  supervisors.  Achievement  test 
results  are  not  to  be  ignored  in  Judging  the  work  of  a teacher, 

i! 

but  it  must  be  realized  that  the  teacher  s influence  is  only  one 
factor  among  many  conditions  which  determine  the  level  of  the 
child's  performance.  For  example,  there  are  such  additional 

i 

||  sources  of  influence  as  native  brightness,  physical  vigor,  home 
j background,  recreational  habits  and  environment,  and  previous 
|j  training  and  experience  - all  contributing  factors  of  great  pot- 
ency  in  determining  the  present  performance  of  pupils.  Unless 
I'  one  secures  reliable  and  comprehensive  evidence  on  these  other 
sources  of  influence,  he  has  little  right  to  attribute  test  re- 
sults to  the  superiority  or  inferiority  of  a particular  teacher 

I 

for  group  of  teachers.  Test  results  from  a class  may  be  taken  as 
suggestive  evidence  of  the  quality  of  teaching,  to  be  confirmed 
or  refuted  by  other  lines  of  evidence,  but  never  to  be  used  as 
the  sole  or  even  the  principal  criterion.  One  should,  therefore, 
be  careful  in  choosing  research  problems  in  this  area.,  with  in- 
tent of  relying  upon  test  results  alone. 

Some  may  consider  the  possibility  of  using  test  results  as 
a means  of  rating  different  educational  institutions....  It  may 
be  pointed  out  in  advance  of  that  discussion  that  the  abilities 
; which  we  measure  by  tests  constitute  only  one  of  many  sets  of 
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I desirable  educational  products;  furthermore,  we  cannot  be  cer- 
j;  tain  how  large  a part  the  school  has  played  in  the  production  of 
even  these  outcomes. 


Not  infrequently  the  results  of  city -wide  survey  testing 
are  made  available  to  principals  and  teachers  for  an  analysis  of 
their  schools  and  classes.  One  must  be  cautious  not  to  put  sur- 
vey tests  to  a more  refined  use  than  is  appropriate.  Although 
test  makers  have  a general  endeavored  to  construct  tests  that 
will  yield  reasonably  accurate  scores  for  an  individual  child, 
it  must  be  understood  that  not  every  test  - and  particularly  not 

ii 

every  survey  test  - provides  for  a sufficient  sampling  of  per- 
formance so  that  a single  individual  is  reliably  described.... 
State  and  regional  achievement  testing.  There  are  a number  of 
regular  achievement  testing  projects  that  cover  large  areas, 
such  as  states,  regions,  or  the  country  as  a whole.  Although 

i i 

these  undertakings  normally  contemplate  considerable  use  of  the 
results  for  individual  pupils,  the  projects,  nevertheless,  have 
obvious  survey  characteristics,  and  they  are  referred  to  here 

i 

I for  that  reason.  In  certain  of  the  states  achievement  tests  are 


given  more  or  less  regularly  by  the  state  department  of  educa- 
tion to  schools  throughout  the  state.  Such  practices  in  six  of 
the  states  have  been  described  by  the  Research  Division  of  the 


I 


National  Education  Association. 

State  testing  programs  especially  for  high  schools  are  de- 
scribed by  Segel....A  number  of  states  have  testing  programs 

! 

for  graduation  from  the  eighth  grade.  These  various  state  pro- 

j 

gragis  are  usually  conducted  by  bureaus  of  research  or  measure- 
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ent  in  the  state  department  of  education,  in  the  department  of 


education  of  the  state  universities,  or  in  some  teacher-training 
institution.  In  some  cases  the  programs  are  carried  on  by  a 
voluntary  organization. 

Several  agencies  conduct  achievement  testing  on  a national 

jj 

scale.  The  Bureau  of  Educational  Measurements  of  the  Kansas 
State  Teachers  College  at  Emporia  conducts  a "Nation-Wide  Every 

Pupil  Scholarship  Test”  in  January  and  April  of  each  year,  which 

!! 

may  extend  over  some  forty-two  states  and  involve  around  a mil- 
lion tests.  This  enterprise  has  been  going  on  since  1925.  The 
stated  purpose  of  the  project  is  "the  promotion  of  scholarship.” 
The  Bureau  makes  its  own  tests  for  these  occasions  and  supplies 
them  to  elementary  and  high  schools  that  desire  them  for  1 l/2^ 
and  2 ^ apiece,  respectively.  Each  school  gives  and  scores  its 
own  tests  and  sends  the  results  to  the  Bureau,  which  then  cal- 
culates norms  for  the  nation,  and  for  many  of  the  individual 
states,  and  returns  these  to  the  schools  which  participated  so 
that  they  may  compare  their  averages  with  the  norms. 

I 

The  Public  School  Publishing  Co.,  of  Bloomington,  111.,  hasl 
also  engaged  in  a nation-wide  testing  program  annually  since 

I 

(l 

1924,  with  possible  follow-up  tests  later  in  the  year;  these  pro- 
grams embrace  both  elementary  and  high  schools  and  are  perhaps 
even  more  extensive  than  the  Kansas  project.  In  addition  to 
these  are  three  agencies  which  confine  their  attention  to  high-  [ 
school  pupils.  College-entrance  examinations  have  long  been 
given  on  a national  basis  by  the  College  Entrance  Examination 
Board,  but  there  are  now  other  agencies,  notably  the  Educational 
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Records  Bureau  of  New  York  City  and  the  Cooperative  Test  Service, 
which  are  interested  in  testing  pupils  in  any  grade  of  the  high 
school . 

i 

It  should  be  said  that  routine  testing  is  not  in  itself  re- 
search, whether  it  is  on  a national  basis  or  in  a single  class- 
room. Reference  has  been  made  to  these  large  testing  programs 
because  they  represent  procedures  for  gathering  data  which  the 
normative-survey  method  employs;  they  may  serve  as  a source  of 
data  for  some  one  who  desires  to  make  use  of  their  results  for 
more  analytical  research  purposes;  and,  finally,  survey  testing 

» 

over  considerable  areas  has  become  an  important  part  of  large- 
scale  research  undertakings  which  may  include  other  kinds  of 
investigation.  Such  surveys  are  often  the  inspiration  for  re- 
search studies.  For  example,  H.  A.  Toops  has  made  many  researches 
from  data  gathered  through  the  tests  of  the  Ohio  College  Asso- 
ciation. Numerous  other  similar  examples  can  be  found. 

Achievement  testing  in  school  surveys.  Survey  testing  of 
educational  attainment  has  become  a large  and  well-established 
part  of  school  surveys.  Caswell  traces  briefly  the  history  of 

i 

the  use  of  tests  in  surveys.  Whereas  in  1911  the  appraisal  of 
instruction  was  based  on  an  inspection  of  the  teaching  by  a 
surveyor,  achievement  tests  were  given  some  recognition  in  a 
1913  survey,  and  considerably  more  use  was  made  of  them  in  1914 
in  the  Butte,  Montana,  survey.  In  the  Cleveland,  G-rand  Rapids, 
and  the  St.  Louis  surveys  of  1916  and  1917,  under  the  influence 
of  Charles  H.  Judd,  achievement  testing  was  raised  to  a height 
that  has  set  a standard  for  all  subsequent  surveys. 
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Achievement  testing  is  now  a regular  part  of  school  surveys 
Testing  in  foreign  countries.  European  countries,  especi- 
ally those  on  the  continent,  do  not  share  the  American  attitude 
toward  testing  to  any  large  degree.  In  general  they  are  actu- 
ated by  a different  basic  philosophy,  which  expresses  itself  in 
other  interests.  Intelligence  tests  are  likely  to  be  used  wherb 
v/e  would  use  achievement  tests.  There  has,  hoY/ever,  been  a lim- 
ited amount  of  investigation  using  achievement  tests,  and  there 
has  been  some  survey  testing.  Educational  testing  in  England, 
France,  Germany, and  China  has  been  summarized  in  the  Review  of 
Educational  Research.  The  student  who  desires  to  get  in  touch 
with  expressions  of  the  European  attitude  at  first  hand  will  be 
interested  in  reading  reports  of  international  conferences  on 
measurement.  These  diverse  attitudes  towards  measurement  should 
suggest  a number  of  problems  for  investigation.... 
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EXAMINATIONS 

UNIVERSITY  ADMINISTR  ATION  by  Charles  W.  Eliot  p.  52,53.  Pub. 
1908. 

"All  the  instruction  given  in  the  University  is  thus  liable 
to  be  inspected  by  visiting  committees  appointed  by  the  Overseers; 
and  the  reports  of  these  committees  are  made  public,  or  kept 
private,  at  the  discretion  of  the  Board.  The  nature  of  the  in- 
struction in  any  department,  and  of  the  examinations  held  by  any 
department,  may  thus  be  made  the  subject  of  a public  report.  It 
is  of  course  difficult  to  obtain  for  all  departments  men,  not 
menbers  of  the  University’s  staff,  who  are  competent  to  criticise 
the  work  of  university  teachers,  particularly  as  the  service  of 
the  Overseers  themselves,  and  of  all  the  committees  that  they 
appoint  is  gratuitous.  Nevertheless,  this  function  of  inspect- 
ion or  examination  has  a high  value,  now  in  one  department  of 
the  University  and  now  in  another.  It  checks  accentricities , 
brings  out  defects,  and  signalizes  merits.  The  Visiting  Com- 

ii 

mittees  have  authority  to  examine  all  question-papers  prepared 
for  university  examinations,  and  all  the  papers  written  by  stu- 
dents in  answering  those  questions.  Since  at  Harvard,  as  at  the 
American  universities  in  general,  the  instructors  have  charge  of 
the  examinations  in  the  courses  they  have  themselves  given,  thi$ 
disinterested  judgment  of  outsiders  on  the  question-papers  and 
answer-papers  may  at  any  time  have  a high  value." 
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UNIVERSITY  AT  'INISTRATIQN  by  Charles  77.  Eliot  p.  182. 

"Written  examinations  lasting  one,  two,  or  three  hours  are 
held  at  intervals  of  about  two  months  or  oftener.  If  four  exam- 
inations  are  held  during  the  year,  two  of  them  may  be  three -hour 
examinations,  and  the  other  two  one-hour.  This  method  is  open 
to  the  objection  that  the  students  may  work  hard  only  spasmodi- 
cally, namely,  shortly  before  each  examination;  the  rest  of  the 
time  they  may  be  in  a passive  condition,  more  or  less  enter- 
tained and  interested,  perhaps,  but  not  using  their  own  minds 
actively  on  the  subject.  The  method  is  good  enough  for  courses 
of  instruction  which  are  intended  to  be  only  introductions  to  a 
thorough  survey,  or  outline  sketches  of  a great  subject  for  per- 
sons who  may,  or  may  not,  propose  a systematic  and  thorough 
study  of  it." 

UNIVERSITY  ADYINISTR  ATION  by  Charles  W.  Eliot  p.  183,  184. 

A skilful  and  alert  instructor  can  sometimes  use  the  whol m 

hour  orofitablv  for  active  discussion  with  the  students  before 
- 

him,  discussion  in  which  the  students  themselves  take  the  major 
part.  If  a portion  of  the  hour  be  given  to  writing,  the  papers 
written  should  be  corrected  and  graded  by  the  instructor.  The 
exercise  should  always  afford  the  means  of  ascertaining  whether 
each  student  in  the  course  has  been  attending  to  the  subject 
during  the  past  week,  or  fortnight,  and  of  marking  or  grading 
his  work." 

UNIVERSITY  ADMINISTRATION  by  Charles  '7.  Eliot  p.  189,  190. 

"in  such  subjects  as  anatomy,  botany,  and  mineralogy,  con- 
siderable quantities  of  material  can  be  issued  to  each  student 
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for  careful  examination  and  description,  and  at  the  end  of  two 
or  three  hours  of  such  study  a short  quizz  or  oral  examination 
may  be  used  to  advantage  with  a group  of  students  who  have  been 
examining  similar,  but  not  the  same,  material." 

ij 

UNIVERSITY  ADMINISTRATION  by  Charles  W.  Eliot  p.  206.  207.  208.  !: 
PubTT^gHT — 


’’Finally,  university  examinations  have  been  greatly  im- 


proved and  systematized  within  the  last  fifty  years,  and  have 
become  a highly  profitable  part  of  university  discipline.  Am- 


erican experience  on  this  subject  is  brief  compared  with  English!. 

! 

The  first  written  examinations  ever  held  in  Harvard  Universit}' 
were  introduced  there  in  the  year  1857  by  two  young  tutors  in 
mathematics.  The  written  examination  has  since  been  studied 


i from  every  possible  point  of  view,  and  adopted  in  all  depart- 
ments of  university  work.  They  are  much  more  than  means  of 
grading  students  and  compelling  the  indifferent  or  careless  stu-fj 
dent  to  do  come  work;  they  constitute  a valuable  means  of  trains 
ing,  inasmuch  as  they  prepare  young  men  to  meet  the  similar 


crises  which  they  constantly  encounter  in  after-life,  particu- 


larly in  the  professions,  -both  learned  and  scientific,  -in  the 
! public  service,  and  in  business  administration." 


TESTS  IN  LIFE 

’’The  professional  man  is  constantly  brought  to  tests  much 
severer  than  any  university  examination  can  ever  be.  The  law- 
yer must  prepare  himself,  often  under  great  difficulties,  to 
plead  his  case  on  a given  day.  The  physician  may  find  himself 
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called  at  any  moment  to  a sick  or  injured  person,  whose  real 
condition  he  must  discover  as  soon  as  possible,  and  must  treat 
forthwith.  He  must  also  decide  what  to  say  to  the  patient,  and 
to  the  patient's  friends  and  relatives.  He  needs  to  have  at  hi£ 
fingers'  ends  all  the  knowledge  and  skill  applicable  to  the  cas€ 
in  hand,  and  he  needs  it  on  a sudden.  The  architect  finds  it  tq 
his  interest  to  present  within  a few  weeks  a design  for  a kind 
of  structure  which  is  not  familiar  to  him,  or  which  must  be 
adapted  to  new  conditions  of  construction  and  use.  He  must 
quickly  summon  all  his  forces,  and  work  at  high  speed  to  pro- 
duce within  a few  weeks  an  attractive  competitive  design.  In 
all  intellectual  callings  there  are  periods  of  intense  labor  to 
prepare  for  a crisis.  For  all  such  work  the  university  examin- 
ations provide  appropriate  and  invaluable  training.  On  this  ac«* 
count  the  disappearance  of  promotion  and  graduation  examination^ 
from  many  schools  - both  elementary  and  secondary  - is  greatly 
to  be  deplored;  the  more  so  because  college  and  university  exam-4 
inations  are  sure  to  be  lowered  in  standard  when  the  students 
who  enter  the  colleges  and  universities  have  had  no  experience 
in  examinations  prior  to  becoming  members  of  their  college  or 
university  on  certificates  from  the  secondary  schools.  A gen- 
eration is  growing  up  in  many  parts  of  the  country  which  has 
successfully  avoided  examinations,  having  acquired  the  belief 
that  examinations  are  an  evil,  instead  of  a profitable  means  of 
sound  training." 

UNIVERSITY  ADMINISTRATION  by  Charles  II,  Eliot  p.  208  , 209. 

"A  peculiar  form  of  examination  which  has  been  developed 
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in  some  university  departments  deserves  mention.  When  an  exam- 
ination is  to  be  held  on  a half-year's  course  in  the  different-, 
ial  calculus,  for  example,  instead  of  preparing  a question- 
paper  containing  eight  or  ten  questions,  the  instructor  res- 
ponsible for  the  course  prepares  a set  of  forty  or  fifty  ques- 
tions which  reallv  cover  the  field  of  instruction  in  that  course, 
so  that  any  one  who  could  answer  all  the  questions  would  demon- 
strate  that  he  had  possessed  himself  of  the  substance  of  the 

ij 

instruction  given  during  the  half-year.  This  long  paper  is 
given  to  the  students  three  or  four  weeks  before  the  date  of  the 
examination.  On  the  examination  day  the  class  is  told  to  answer 

i 

six  or  eight  of  the  questions  on  the  list.  This  method  is  an- 
alogous to  the  use  of  a full  syllabus  to  define  to  a class  at 
the  beginning  the  professor's  conception  of  the  subjects  he 
shall  cover  during  the  entire  course  which  they  are  entering  on. 
In  any  university  there  will  be  some  departments  in  which  this 
mode  of  examination  can  be  occasionally  adopted  to  advantage." 
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The  following  selection  is  copied  verbatim  from  The  New 
International  Encyclopaedia  , Second  Edition,  Vol.  XXII,  1923 
Pub.  by  Dodd,  Mead,  and  Company,  New  York  City,  page  130 

"Numerous  acts  of  the  English  Parliament  imposing  religious 
tests  upon  persons  in  public  office.  The  most  famous  are  the 
Corporation  Act  of  l66l  and  the  Test  Act  of  1693.  The  Corpora- 
tion Act  directed  that  all  magistrates  should  take  the  oaths  of 
allegiance  and  supremacy,  as  well  as  an  oath  renouncing  the 
doctrine  that  it  is  lawful  to  take  arms  against  the  king,  and 
provided  that  they  must  receive  communion  according  to  the  rites 
of  the  Church  of  England.  The  Test  Act,  so  called,  imposed  the 
like  conditions  on  the  holders  of  all  public  offices,  civil  and 
military,  and  obliged  them  in  addition  to  abjure  all  belief  in 
the  doctrine  of  transubstantiation.  Both  of  these  acts  were 
the  result  of  the  struggles  against  the  Catholics  in  the  reign 
of  Charles  II.  They  were  repealed  in  1828  as  regards  most  of 
the  provisions. 

The  New  International  Encyclopaedia  Second  Edition  Vol  XXII 
pub.  in  1923  by  Dodd,  Mead,  and  Company,  N.  Y.  C.  page  4 14 

"As  early  as  1877  Francis  G-alton  suggested  the  use  of  the 
reaction  experiment  for  the  diagnosis  of  temperament.  In  con- 
nection with  anthropological  measurements  of  weight,  height, 
eye  color,  and  the  like,  he  further  developed  a number  of  simple 
tests  which  he  hoped  would  make  it  possible  to  "obtain  a gen- 
eral knowledge  of  the  capacities  of  a man  by  sinking  shafts,  as 
it  -were,  at  a few  critical  points. 

In  the  early  nineties  of  the  past  century  mental  tests 
came  into  prominence  in  America." 
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The  following  selection  is  copied  verbatim  from  The  Lincoln 
Library  of  Essential  Information.  Pub.  by  the  Fronier  Press 

OCCUPATIONAL  TESTS 


"The  army  also  had  need  of  a system  of  classification 
whereby  it  could  place  men  in  the  industrial  activities  which 
were  necessary  for  carrying  on  the  war.  For  example,  some  men 
were  needed  who  were  expert  mechanics;  some  were  needed  to  keep 
the  army  accounts.  The  locating  of  men  suited  to  these  lines 
of  occupation  could  be  effectively  handled,  in  part,  through 

l 

a knowledge  of  the  earlier  occupations  which  the  men  had  follow4 
ed.  In  many  instances,  however,  it  was  necessary  to  put  men 

i; 

into  lines  of  work  which  we re  different  from  those  that  had 
been  familiar  to  them  in  civilian  life,  and  tests  were  needed 
in  order  to  avoid,  so  far  as  possible,  misfit  assignments. 
Fortunately  the  psychological  methods  for  making  such  tests  had 
been  worked  out  in  a great  deal  of  detail  in  a number  of  centers 
before  the  war  came.  The  psychologists  of  the  country  promptly 
came  forward  with  the  experience  which  they  had  accumulated  in 
these  earlier  experiments  and  became  an  important  part  of  the 
army  organization.  Special  series  of  tests  were  devised  by  a 
number  of  commissions. " 

THE  ARMY  ALPHA  TEST . This  is  the  most  extensively  used  of  the 
army  tests. 

INTERPRETING-  RESULTS  OF  THE  ALPHA  TEST,  page  1655 

The  results  of  the  army  tests  have  been  compiled  by 

various  writers  in  an  effort  to  bring  out  the  mental  character-  |j 

■j 

istics  of  the  army  recruits  from  different  sections  of  the 
country  and  from  different  nationalities.  One  author  has  com- 
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piled  the  results  of  these  tests  in  such  a way  as  to  show  very 
definitely  that  the  immigrants  who  come  tot  he  United  States 
from  the  southeastern  European  countries  are  not  able  to  pass 
the  test  with  as  high  a grade  as  the  immigrants  who  come  from 
the  northern  European  states.  In  view  of  the  fact  that  recent 
immigration  has  been  predominantly  from  the  countries  in  the 
southeastern  part  of  Europe,  these  findings  raise  grave  social 
questions. 

Another  general  fact  brought  out  by  these  tests  is  that 
the  average  recruit  was  able  to  answer  the  tests  only  about  as 
well  as  school  children  between  13  and  14  years  of  age.  On  the 
basis  of  this  fact,  the  statement  is  sometimes  made  that  the 
average  American  citizen  is  intellectually  between  13  and  14 
years  of  age.  Against  this  statement  it  has  been  argued  that 
the  tests  include  only  those  types  of  intellectual  effort  which 
belong  to  a school  training. 

Beyond  13  years  of  age  the  ordinary  man  does  not  continue 

I 

to  cultivate  the  same  type  of  thinking  which  he  cultivated  in 
the  school.  Consequently,  the  test  does  not  uncover  the  mental 
development  which  has  been  going  on,  for  example,  in  business 
or  in  practical  mechanics.  There  is  nothing  in  the  test  to  show 
what  a man  who  works  in  a foundry  has  been  learning  since  he 
left  school. 

Controversy  as  to  the  meaning  of  the  test  has  arisen  at 

i 

another  point  also*  There  are  some  who  regard  the  test  as  a 
measure  of  native  ability,  while  others  regard  it  as  a measure 

i] 

o f_  a cqulred  information.  If  the  test  mea sur es  native  ability,  ji 
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then  it  is  not  to  be  expected  that  anyone  who  passes  the  test 
well  at  any  given  time  will  be  of  low  mental  ability  at  any 
other  time  in  his  life.  Conversely,  anyone  who  is  not  able  to 
pass  the  test  at  a level  that  comports  with  his  age  cannot  be 
expected  to  show  intellectual  ability  of  a higher  order  later. 
Those  who  believe  that  the  test  measures  acquired  information, 
on  the  other  hand,  interpret  the  results  to  mean  that  a man  has  ji 
had  certain  intellectual  opportunities  if  he  passes  the  test 
well,  and  that  he  has  been  deprived  of  those  opportunities  if 
he  does  not  pass  well. 

It  has  been  shown  very  clearly  that  the  ability  of  recruits 
from  different  states  parallels  closely  the  efficiency  of  the 
school  systems  of  these  states.  This  fact  would  seem  to  indi- 
cate that  the  test  measures  school  training  quite  as  much  as  it 
does  native  intelligence.  In  general,  this  later  conclusion  is 
probably  more  nearly  the  exnct  truth  than  the  statement  that  the 
test  measures  only  native  ability. 

EXAMINING  UNIVERSITIES,  page  1662 

There  are  also  in  England  certain  examining  institutions. 
Thus  the  University  of  London  is  not  altogether  a teaching  in- 
stitution;  it  awards  degrees  to  candidates  who  present  themselve'p 
for  examination  after  independent  study  in  some  particular  field. 
SCHOOLS  IN  OTHER  COUNTRIES  page  1662 

’ll 

The  contrast  which  is  to  be  drawn  between  Germany  and 
England  is  expressed  in  the  statement  that  the  German  school  is 
a rigid  and  well  organized  system,  with  each  part  of  the  system 
clearly  defined  and  distinct  from  the  other  branches.  In 
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England  adjustments  are  very  much  freer  and  less  highly  system- 
atized. The  success  of  the  English  school  system  depends  upon 
the  success  of  the  examination  system,  which  is  organized  with 
a view  to  permitting  individual  readjustments  on  a liberal  scale. 
EUROPEAN  STATES. 


Other  countries  have  been  dominated  in  their  educational 
organization  by  the  German  and  English  examples  in  varying  de- 
grees. Those  countries  in  which  the  influence  of  Germany  has 
been  most  pronounced,  such  as  Austria,  Hungary,  and  the  south- 
eastern European  states,  have  adopted  the  German  system  so  far 
as  their  social  and  economic  development  would  permit.  Usually 
these  countries  have  failed  to  reach  a complete  realization  of 


the  German  ideals  in  education,  but  their  systems  have  been 
modeled  on  the  German  plan. 

BRITISH  DOMINIONS.  page  1663 

The  colonies  of  England,  such  as  Canada,  Australia,  and 
South  Africa,  have  developed  an  educational  system  modeled  on 
the  English  plan.  In  many  instances  these  school  systems  have 
secured  their  examinations  from  the  examining  boards  of  England, 

| 

thus  aiming  to  follow  the  standards  set  up  in  the  mother  country. 
The  very  freedom  of  the  organization  has,  however,  resulted  in 
a departure  both  in  standards  and  in  exact  form  from  the  example 
of  England.  Thus,  we  find  that  in  Canada  the  higher  institutions 

I 

have  in  some  cases  approached,  in  the  form  of  their  organization, 

i 

the  high  s chools  of  the  United  States,  departing  radically  from 
the  traditions  of  English  organization  of  secondary  schools. 

This  departure  from  English  models,  however  is  not  complete, 
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and  there  are  many  secondary  schools  in  Canada  which  closely 
approach  the  English  type.  The  Canadian  high  school  is  in  some 
cases  paid  for  entirely  out  of  public  funds,  thus  also  depart- 
ing from  the  practice  of  the  English  higher  schools,  which  al- 
ways charge  a fee  for  admission. 


METHODS  OF  COLLEGE  ADMISSIONS . page  1672 

Prior  to  the  organization  of  the  standardizing  associations 
the  common  practice  of  American  colleges  was  to  administer  en- 
trance examinations  to  all  students  passing  from  the  secondary 
school  into  college.  The  entrance  examination  system  came  to 
this  country  from  England,  where  it  is  the  chief  means  of  regu- 
lating the  work  of  all  educational  institutions.  It  is  still 
the  dominant  method  of  college  admission  in  the  states  east  of 
the  Allegheny  mountains.  The  University  of  Michigan,  establishe 


in  1837,  devised  the  method  of  admission  by  certificate,  and 
thus  broke  away  from  the  examination  system  of  the  older  Ameri- 

!! 

can  institutions. 

The  theory  on  which  the  University  of  Michigan  proceeded 
was  that,  as  the  highest  institution  of  learning  in  the  state, 
it  had  responsibilities  which  obligated  it  to  provide  through 
inspection  and  advice  for  the  development,  not  only  of  its  own 
courses,  but  also  of  the  courses  of  the  other  institutions  in 
the  state.  The  University  of  Michigan,  therefore,  began  to  send 
members  of  its  faculty  to  visit  the  high  schools  and  encourage 
them  in  perfecting  their  methods  of  organization.  When  a stu- 
dent came  from  on  of  these  inspected  high  schools  he  was  receive 
into  the  college  as  a satisfactory  student,  because  the  institu- 
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tion  from  which  he  came  was  known  to  conform  to  the  requirements 
of  the  university.  The  certificate  qystem  has  spread  rapidly, 
especially  in  the  Middle  West  and  the  West,  and  is  today  the  ac- 
cepted mode  of  college  admission  west  of  the  Allegheny  mountains 
In  recent  years  the  use  of  general  intelligence  tests  has 
been  advocated  as  a much  better  device  than  examination  or  cert- 
ification to  determine  who  shall  pass  from  the  high  school  into 
college.  Elaborate  studies  have  been  made  of  the  success  with 
which  the  work  of  college  students  can  be  prognosticated  on  the 
basis  of  their  school  records,  by  entrance  examinations  in  the 
particular  subjects,  or  through  general  intelligence  tests.  It 
has  been  found  that  the  school  record  and  general  intelligence 
tests  are  distinctly  superior  to  examinations  in  particular  sub- 
jects. General  intelligence  tests  serve  also  to  correct  the  es- 
timate of  the  student  based  on  his  school  record.  The  school 
record  is  determined  in  many  instances  by  other  considerations 
than  native  intelligence.  Thus,  an  industrious  student  who  is 
dull  may  sometimes  make  a better  record  than  a bright  student 
faho  is  not  attentive  to  his  work.  College  officials  have  found 
it  advantageous,  therefore,  in  dealing  with  students,  to  collect 
the  information  supplementary  to  the  school  record,  as  a basis  of 
the  classification  and  administration  of  the  school  body. 
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Strang,  Ruth.  "Developments  in  Student  Personnel  Research" 

Teachers  College  RECORD,  pp. 120-133,  Nov.  1933 

"Selecting  students  who  will  fit  the  college  has  been,  for 
many  years  and  endeavor  of  college  administrators.  Even  though 
the  aim  increasingly  becomes  'to  fit  the  college  to  the  student, ' 
the  need  remains  for  giving  an  individual  some  basis  for  predict- 
ing his  probable  success  in  a preferred  curriculum. 

I 

"The  first  steo  has  been  to  ascertain  the  relationship  be- 
tween intelligence  test  scores  and  college  success,  and  between  | 
high  school  marks  and  college  success.  The  superior  predictive 

yalue  of  tests  was  indicated  by  some  investigations,  and  that  of  I 

I 

records  of  high  school  achievement  by  others.  Both  these  measure^ 
3how  a definite  relation  to  success  in  college  as  measured  by 
Freshman  marks.  \t  Yale,  for  example,  Crawford  and  Burnham  found 
the  high  school  record  the  most  important  single  factor  in  the 
prediction  of  freshman  scholarship. ...  The  wide  variations  in  re- 
sults are  due  to  differences  in  the  tests  and  in  high  school  mark- 
ing systems,  and  inthe  higher  institutions  to  admission  policies, 
nature  of  student  body,  methods  of  instruction,  etc. 

"...Research  in  regard  to  selective  admissions  has  been  of 
falue  to  the  personnel  worker  in  showing  the  degree  of  relation- 
ship that  exists  between  scholastic  success  in  college  and  such 
factors  as  intelligence  test  scores,  teachers'  marks  in  high 
school, ratings,  college  entrance  board  examinations,  personality 
sests,  subjects  taken,  and  number  of  credits.  It  has  also  been 
>f  value  in  showing  the  lack  of  relationship  that  exists  in  a 
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certain  percentage  of  cases  even  when  the  best  criteria  and  com-  i 
binations  of  criteria  are  used. 

"...The  large  number  of  investigations  of  characteristics 
of  students  has  revealed  manifold  differences  in  students  and 
has  pointed  to  the  need  of  studying  personality  patterns  instead 
of  isolated  traits.  Investigators  are  still  searching  for  an 
adequate  method  of  studying  'the  whole  individual.'" 

Spence,  Ralph.  "A  Comprehensive  Testing  Program  for  Elementary 

Schools."  Teachers  College  RECORD,  pp. 279-285, 
Jan.  1933. 

During  the  earlier  years  of  test  development,  many  schools 
were  inclined  to  use  tests  in  the  uncritical  way  which  is  so 
often  characteristic  of  the  reception  of  a new  discovery... 

"it  is  clear  from  the  above  discussion  that  standardized 
tests  are  to  be  used  for  very  definite  purposes  and  with  a real- 
ization of  the  values  already  available  in  teachers'  marks  and 
sstimates.  The  test  results  should  be  insuch  form  as  to  permit 
peady  use  by  the  class-room  teacher.  Elaborate  statistical  man- 
ipulations cannot  be  expected.  "...The  important  thing  to  re- 
inember is  that  the  tests  given  are  to  serve  definite  educational 
ends.  Start  modestly  with  relatively  few  tests,  and  be  sure  that 
the  possibilities  of  these  are  exhausted  or  that  there  are  def- 
inite objectives  not  being  met  by  the  present  testing  program  be- 
fore others  are  added. 

"When  tests  are  used  sporadically,  they  are  likely  to  be  ex- 
pensive. In  a school  system  of  1,000  children  in  Grades  1 to 
Vlll  the  total  cost  of  the  tests  for  the  program  outline  would 
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be  about  $120  or  12  cents  per  pupil.  Taking  $75  as  an  average 
total  expenditure  per  pupil  in  elementary  school,  this  is  not 
an  expensive  item.  It  would  be  difficult  to  find  an  equivalent 
expenditure  which  would  yield  greater  returns. " 

Noll,  Victor.  "Measuring  Scientific  Thinking."  Teachers  College 

RECORD,  pp.  685-694.  May,  1934 

"The  purpose  of  the  present  article  is  to  detail  what  is 
being  accomplished  to  develop  tests  of  scientific  thinking  which 
will  be  consistent  with  the  points  of  view  expressed  in  the  pre- 
vious articles.  The  six  habits  of  thinking  described  in  the 
first  article  provide  the  chief  basis  for  this  part  of  the  work, 
as  they  do  for  the  entire  program.  These  habits  are  accuracy, 
suspended  judgment,  open-mindedness,  intellectual  honesty,  crit- 
icalness, and  the  habit  of  looking  for  true  cause  and  effect  rel- 
ationships. . . . 

"With  such  tests  available  it  should  not  only  be  possible 
but  practical  to  conduct  experiments  with  school  children  in  the 
teaching  of  scientific  thinking.... 

"Scientific  thinking  i_s  better  thinking." 

Hildreth,  Gertrude.  "Mental  Ability  Measured  by  Verbal  and  Non- 

Verbal  Tests."  Teachers  College  RECORD, 
pp.  134-144,  Nov.  1932. 

"The  highly  verbal  nature  of  many  intelligence  tests  is 
their  most  commonly  criticized  feature.  This  criticism  is  based 
on  the  wide-spread  belief  that  facility  in  the  use  of  symbols 
and  language  is  only  one  kind  of  intelligence;  that  ability  to 
deal  satisfactorily  with  social  situations  or  practical  problems 
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indicates  the  possession  of  other  kinds  of  intelligence.  Tests 
involving  reading  and  written  responses  test  the  former  but  not 
the  latter  capacities,  it  is  claimed.  A number  of  performance 
tests  have  been  constructed  for  the  sole  purpose  of  measuring 
the  abilities  of  pupils  who  have  proved  to  be  incapable  when 
measured  by  verbal  tests  of  mental  ability....” 
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The  following  selection  has  been  copied  verbatim  from  the  Journal 
of  Educational  Research.  October,  1936.  p.155. 

Comprehensive  Examinations  in  the  Chicago  Junior  Colleges. 

"Courses  in  English,  composition,  biological  science,  the 
humanities,  physical  science,  and  social  science  constitute  the 
required  portion  of  the  curriculum  of  the  three  Chicago  municipal 
junior  colleges.  The  typical  freshman  studies  English,  composi- 
tion, the  first  year  of  social  science,  biological  science  or 
physical  science,  and  a number  of  elective  courses.  The  typical 
sophomore  enrolls  in  the  humanities,  biological  science  or  phy- 
sical science,  the  second  year  of  social  science,  and  several 
elective  courses.  The  achievements  of  the  students  enrolled  in 
the  required  courses  named  above  are  measured  by  comprehensive 
examinations  prepared  by  the  Department  of  Examinations,  with 
the  assistance  of  the  faculties  concerned.  Each  of  these  exam- 
inations is  designed  to  cover  one  full  year  of  study.  The  scores 
and  marks  are  used  in  determining  eligibility  for  graduation. 

They  are  also  used  to  provide  data  on  which  to  base  recommenda- 
tions of  students  to  higher  institutions,  and  to  provide  inform- 
ation  useful  in  educational  and  vocational  counseling.  Ultimate- 
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ly,  six  comprehensive  examinations,  corresponding  to  the  courses 
named  will  he  given  each  semester.  No  examination  for  the  sec- 
ond-year course  in  social  science  was  necessary  in  June,  1935. 

The  following  topics  are  considered  in  a report  describing 
the  1935  examinations,  prepared  by  M.  D.  Engelhart:  (1)  the  prep 

aration  of  the  examinations;  (2)  the  administration;  (3)  the  scori 
ing;  (4)  the  D-score;  (5)  the  assignment  of  letter  grades;  (6) 
ithe  distributions  of  original  scores,  D-scores,  and  letter  grades 
(7)  the  reliability  of  the  examinations;  and  (8)  the  analysis  of 

i 

the  achievement  of  the  "average"  student.  The  report  concludes 
with  some  inferences  derived  from  the  data  and  with  some  recom- 
mendations based  upon  these  inferences." 

'^Iowa  Testing  Program.  - For  a long  time  a number  of  educational 
Workers  have  felt  the  need  of  types  of  appraisal  of  instruction 
[which  give  an  adequate  picture  of  what  is  being  accomplished, 
Which  show  deficiencies  wherever  they  may  exist,  and  which  afford 
data  that  may  readily  be  made  the  basis  for  a program  of  improve- 
ment. It  is  claimed  that,  under  the  direction  of  E.  F.  Lindquisl^ 
hnd  with  the  cooperation  of  the  staff  of  the  College  of  Education 
University  of  Iowa,  such  a battery  of  tests  has  been  developed." 

"For  the  past  eight  years  the  College  of  Education  and  the 
Extension  Division  have  provided  a cooperative  regional  testing 
service  known  as  the  Every-Pupil  Testing  Program.  One  of  the  most 
important  outgrowths  of  this  experience  has  been  the  development 
of  a comprehensive  battery  of  tests  of  the  basic  skills  in  read- 
ing, study,  language,  and  arithmetic  for  grades  six  to  eight. 
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The  second  (1936)  edition  of  these  tests  was  given  to  over  40,00C 
students  in  January,  1936." 
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The  following  selection  is  copied  verbatim  from  the  book  by 
Fish,  Louis  J. 

Examinations  Seventy-five  Years  Ago  and  Today. 

Comparison  & Results  of  Entrance  Examinations  to  High  School. 

World  Book  Company,  Yonkers-on-Hudson,  New  York  1930 

1.  The  first  thing  noted  in  the  examination  in  grammar  fcr 
1853  was  a notation  that  "errors  in  spelling  or  in  punctuation" 
were  not  to  be  counted.  In  other  w ords,  the  emphasis  was  to  be 
placed  on  technical  phases  of  grammar;  and  the  other  aspects, 
such  as  clear  expression  and  the  correctness  of  composition, 
spelling,  punctuation-,  and  capitalization,  were  to  be  ignored 
entirely . 

2.  There  have  been  such  radical  changes  in  the  teaching  of 
grammar  within  even  recent  years  that  it  is  hardly  fair  to  expect 
present-day  pupils  to  cope  with  the  technicalities  of  formal 
grammar  required  seventy-five  years  ago.  The  present  emphasis 

is  not  placed  on  parsing  or  diagraming. 

3.  The  examination  of  1928  lays  emphasis  on  a minimum  require- 
ment in  grammar.  The  emphasis  is  on  free,  clear,  and  well-worded 
expressions  of  thought.  Nevertheless,  it  may  not  be  said  that 
grammatical  correctness,  spelling,  punctuation,  and  capitaliza- 
tion are  neglected.  Deductions  are  made  for  the  failure  to  em- 
ploy them  properly. 

4.  Shortly  after  the  examination  of  1853  a decline  in  emphasi^ 
upon  technical  grammar  was  inaugurated.  This  decline  has  been 
gradual,  until  present-day  educators  are  unanimously  in  agreement 
upon  a modicum  of  instruction  in  formal  grammar. 

5.  In  1853  the  purpose  of  the  examination  was  to  find  what 
knowledge  the  pupil  had  of  grammatical  structure,  declensions, 
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naming  the  parts  of  speech,  plural  formation  of  uncommon  words, 
comparison  of  unusual  adjectives  and  the  parsing  of  simple  sen- 
tences. 

6.  Therefore  in  1853  no  test  was  given  for  the  power  of  ex- 
pression in  clear,  grammatical  English.  Composition  and  its  re- 
lated spelling,  punctuation,  a.nd  capitalization  were  not  requirec. 
of  the  pupils  seeking  admission  to  high  school.  It  appears  in- 
credible that  the  pupils  of  1853  could  have  made  a passing  mark 
on  the  present-day  examination.  At  that  time  English  compositioh 

i I 

iwas  not  studied  until  the  latter  part  of  the  high  school  course,  j 

7.  Present-day  pupils  had  some  difficulty  with  the  examination 

I 

of  1853,  although  without  doubt  sufficient  grammar  is  now  taught 
i to  eighth-grade  pupils  to  enable  them  to  secure  an  excellent 
mark.  The  pupils  of  1853  also  experienced  difficulty  with  the 
same  subject,  as  noted  in  the  tabulations. 

8.  The  1853  test  sought  to  ascertain  what  the  child  could  re- 
tain and  not  what  the  child  could  express.  It  concerned  itself 
with  the  technicalities  which  the  child  had  acquired  and  did 
attempt  to  ascertain  whether  they  functioned  properly  in  written 
expression. 

9.  Grammar  in  and  of  itself  is  only  a tool  to  correct  English, 
to  know  the  rules  of  grammar  without  a knowledge  of  their  appli- 
cation is  not  satisfactory. 

10.  Grammar  functions  only  in  oral  or  written  expression. 

Oral  or  written  composition  tests  the  power  to  use  grammatical 
knowledge  propdrly.  The  ability  to  memorize  grammatical  data  and 
to  remember  rules  does  not  necessarily  lead  to  the  correct  use  olf 
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those  rules  unless  there  is  practice  in  the  application. 

1.  A comparison  of  these  two  examinations  shows  that  in  1853 
the  examination  in  geography  was  factual  and  placed  the  emphasis 
on  location.  The  questions  did  not  involve  the  reasoning  process 
in  any  way.  In  fact,  they  tend  to  minimize  the  importance  of 
thought  and  judicial  reflection  on  the  part  of  pupils.  In  cor- 

such  papers,  the  answers  admit  of  no  variation.  For  ex- 
There  is  only  one  answer  to  the  question,  "What  is  the 
capital  of  Spain?”  If  the  answer  is  not  Madrid,  no  credit  can 
be  given.  The  entire  examination  is  fundamentally  a memory  test. 

2.  The  examination  of  1928,  while  still  emphasizing  the  fac- 
tual and  location  aspects  of  geography,  attempts  to  draw  from 
the  pupil  reasons  and  conclusions  based  on  a knowledge  of  facts. 
In  this  instance  the  student  may  exercise  judgment  in  selecting 
the  material  fcr  his  answer.  In  the  first  question,  "Why  is 
New  England  an  important  manufacturing  region?"  undoubtedly  many 
reasons  could  be  given.  But  here  the  examiner  adapts  his  stand- 
ard of  correct  response  to  the  age  of  the  pupil  and  the  knowledge 
which  an  eighth-grade  pupil  is  expected  to  have  on  this  subject. 
Throughout  the  1928  examination  the  "why"  and  the  "reason"  are 
the  significant  factors.  In  this  instance  the  examiner  when  cor- 
recting the  papers  must  exercise  judgment.  Rarely  can  he  give  a 
mark  of  zero  or  a perfect  mark  to  any  answer.  The  answer  in  ques 
tion  5 of  the  1853  examination  can  be  given  full  credit  only  if 
correct,  or  no  credit  at  all  if  incorrect.  The  examiner  marking 
the  examination  of  today  would  have  to  give  a failing  mark  which 
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might  vary  from  1 to  59,  or  give  an  A,  B,  or  C which  might  vary 
from  60  to  98. 

3.  Such  an  examination  as  was  given  in  1853  may  easily  be  pass- 
ed by  hasty  cramming.  The  1928  examination  encourages  reflection. 
It  calls  for  the  marshaling  of  related  facts  and  for  the  selec- 
tion of  material  requisite  for  the  written  answers. 

4.  The  1928  examination  tests  the  relation  of  geographical 
facts  in  connection  with  human  development  - for  geography,  after 
all,  is  the  story  of  the  earth  as  the  home  of  mankind.  In  this 
examination  memory  is  less  important  than  the  development  of  the 
power  to  reason  from  the  known  facts  to  unknown  facts.  It  demands 
organization  of  knowledge,  such  as  occupations,  products,  climate, 
cities,  and  other  geographical  data  in  relation  thereto. 
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The  following  selection  is  copied  verbatim  from  Modern  Methods 
In  Written  Examinations  by  Lang. 

Ancient  origin  of  examinations.  Examinations  have  an  ancient 
origin.  It  is  not  known  when  or  where  they  first  made  their 
appearance.  Their  beginnings  have  long  been  lost  in  the  hoary 
past.  77 e read  in  the  Old  Testament  of  an  examination  in  which, 
at  the  passage  of  the  Jordan,  the  Gileadites  tested  the 
Ephraimites  upon  their  ability  to  pronounce  the  work  "Shibboleth 
Any  Ephraimite  who  failed  to  pronounce  the  aspirat  and  answered, 
"Sibboleth"  was  slain  on  the  spot.  On  that  fatal  day  forty-two 
thousand  are  reported  to  have  failed  in  their  examinations. 

This  tragic  test  is  by  no  means  the  first  instance  of  exam- 
ination. Tests  of  mental  and  physical  traits  have  been  involved 
in  the  initiation  ceremonies  of  primitive  peoples  from  times 
long  past.  The  passing  of  these  was  considered  essential  before 
assuming  the  responsibilities  of  adulthood.  By  at  least  500  B.C 
both  the  Athenian  and  Spartan  Greeks  held  periodic  examinations 
for  testing  the  skill  and  capacities  of  their  youth.  The  Spartartfs 
tested  ability  to  endure  pain  by  conducting  regular  examinations } 
in  the  forrnof  whippings,  before  the  altar  of  Artemis  Orthia. 
Socrates  in  his  famous  method  of  teaching  submitted  his  pupils 
to  exhaustive  and  searching  questioning.  The  catechetical  methocf 
of  teaching  of  the  early  Christians,  with  its  questions  and  an- 
swers, have  evolved  from  antiquity  and  have  persisted  down 
through  the  ages. 

Influence  of  the  medieval  universities.  The  medieval  universitie 


have  served  in  many  respects  as  models  for  modern  universities 
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Prominent  among  the  features  copied  from  them  is  the  examination 
idea.  The  early  university  was  simply  a guild  or  association 
of  persons  who  were  interested  in  teaching. 

In  common  with  the  various  trade  guilds  of  the  time  the 
teaching  guild  had  its  successive  stages  of  apprentice,  journey- 
man, and  master.  Promotion  from  a lower  stage  to  a higher  one 
depended  upon  passing  an  examination.  The  completion  of  the 
apprentice  stage  entitled  the  candidate  to  the  baccalaureate 
degree,  and  was  determined  by  a test  of  his  ability  to  define 
and  explain  terms.  The  completion  of  the  journeyman  stage  en- 
titled the  candidate  to  the  master’s  or  doctor’s  degree,  and  was 
determined  by  a test  of  his  ability  to  despute  and  to  defend  a 
thesis.  There  are  records  of  such  examinations  at  the  University 
of  Bologna  as  early  as  A. D. 1219  and  at  the  University  of  Paris 
fby  the  end  of  the  thirteenth  century.  Comenius,  in  his  Great 
D idactic . planned  university  training  only  for  those  who  could 
pass  a rigid  examination. 

The  examinations  of  the  early  universities  were  oral.  The 
written  form  in  universities  seems  to  have  been  a development  of 
the  early  eighteenth  century.  China,  however,  used  a written 
form  at  least  as  early  as  the  seventh  or  eighth  century.  Probably 
the  first  written  examination  at  a university  was  in  1702,  when 
it  was  introduced  at  Cambridge,  England.  Soon  after  this,  Oxford 

i 

and  other  English  schools  took  up  the  written  form.  By  the  time 
the  Pilgrim  fathers  came  to  America  the  examination  system  was 
fairly  well  established  in  England.  There  seems  to  be  no  doubt 
but  that  the  universities  of  the  middle  ages  gave  the  examination 
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system  to  our  we stern  civilization. 

The  Boston  examination  of  1845.  The  first  examination  of  histor- 
ic interest,  in  our  own  country,  is  the  Boston  examination  of 
1845.  One  of  the  early  duties  of  the  Boston  school  committee 
was  to  make  a formal  inspection  of  the  schools  each  year.  This 
included  an  oral  examination  of  the  pupils.  As  the  schools  grew 
and  the  number  of  pupils  increased,  it  became  an  impossible  task 
for  the  committeemen  to  examine  all  the  pupils.  A plan  of  re- 


i 


stricting  the  examinations  to  the  first  (highest)  class  in  each 
school  accordingly  was  adopted.  This,  also,  became  an  impossible 
task  with  the  continued  growth  of  the  schools.  As  a result  the 
annual  inspection  of  the  schools  eventually  became  a perfunctory 
and  formal  official  routine,  without  much  significance.  In  1848, 
the  school  committee  concluded  to  appoint  a sub-committee  whose 
duty  and  responsibility  it  w ould  be  to  make  the  annual  examina- 
tions of  the  grammar  department  of  all  the  schools  of  Boston. 

This  sub-committee  went  about  its  task  with  much  thoroughness 
and  seriou  sness.  It  decided  to  give  a v/ritten  examination,  and 
to  have  a series  of  questions  prepared  and  printed  covering  all 
the  subjects  which  were  then  studied  in  the  schools.  Printed 
questions  were  decided  upon  in  order  to  make  the  examination  as 
fair  as  possible;  to  give  all  pupils  the  same  opportunities;  to 
avoid  leading  questions;  to  provide  a permanent  record  of  the  ex- 
amination; to  determine  what  the  pupils  did  not  know,  as  well  as 
what  they  did  know;  to  examine  readiness  in  v/ritten  expression; 
and  to  test  ability  in  grammatical  sentence  construction,  punctua 
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tion,  and  spelling.  The  examination  included  the  subjects  of 
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astronomy,  definitions,  geography,  grammar,  history,  and  natural 
philosophy.  Boston  at  that  time  had  nineteen  public  grammar 
schools.  The  examinations  were  given  to  the  highest  classes,  and 
included  530  pupils,  or  something  over  seven  per  cent  of  all  the 
pupils  enrolled  in  the  Boston  schools  at  that  time.  The  pupils 
p.veraged  somewhere  around  fourteen  years  of  age.  The  examination 
was  composed  of  154  printed  questions.  There  were  14-  questions 
in  grammar;  natural  philosophy  had  20  questions;  and  the  other 
subjects  had  about  30  questions  each.  Prom  this  it  is  evident 
that  the  Boston  examination  of  1845  was  a comprehensive  written 
examination. 

The  details  of  administering  the  Boston  examination  were 
worked  out  carefully.  Precautions  were  taken  to  prevent  any  of 
the  schools  from  getting  advance  information  about  the  nature  of 
the  questions,  which  were  prepared  and  printed  secretly.  The 
three  committee  members  followed  a secret  schedule.  By  eight 
o’clock  in  the  morning  they  appeared  unannounced  at  different 
schools  and  commenced  the  examination.  They  gathered  up  the 
pupils’  books  and  reference  materials,  seated  them  far  enough 
from  each  other  to  prevent  communication,  advised  them  that  they 
would  have  an  hour  for  the  examination,  warned  them  against  tak- 
ing time  to  write  handsomely  as  that  would  not  be  given  consid- 
eration in  the  grading,  passed  out  the  printed  questions  on  the 
subjects  to  be  tested  that  day,  and  set  them  to  work.  At  the 
end  of  the  hour,  the  committee  member  gathered  up  the  examination 
paners,  nurried  to  his  next  school,  remained  there  for  an  hour’s 
examination,  and  on  to  the  third,  completing  three  schools  during 
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the  forenoon.  In  the  afternoon  three  more  schools  were  completed 
by  each  member  of  the  committee,  who  finished  in  one  day  the 
examination  for  one  subject  in  all  the  schools.  The  next  day 
they  took  the  questions  of  another  subject,  and  continued  in  thi 
way  until  they  had  completed  their  examination  program  for  the 
school . 

Careful  thought  was  given  to  the  preparation  and  scoring 
of  the  questions,  and  to  the  interoretation  of  the  results.  In 

i 


s 


the  preparation  of  the  examination  the  committee  tried  to  grad- 
uate the  questions  simple  enough  for  the  poorest  pupils  to  under 
stand  and  answer,  and  to  include  others  of  sufficient  difficulty 
to  tax  the  powers  of  the  best  pupils.  Rules  were  prepared  for 
the  scoring  of  the  papers.  These  were  used  as  guides,  although 
they  were  not  rigidly  applied.  The  policy  was  to  give  the 
pupil  the  benefit  of  the  doubt.  Based  upon  the  results  the  com- 
mittee ranked  the  schools  in  order  of  merit  according  to  the 
comparative  number  of  correct  answers  given  to  the  questions. 

The  committee's  interpretation  of  the  ranking  of  the  schools 
and  the  confidence  they  placed  in  the  examination  results  were 
very  constructive.  They  pointed  out  that  the  ranking  was  based 
on  an  approximate  estimate  of  the  intellectual  acquirements  of 
the  pupils  as  shown  by  the  examination,  and  not  upon  an  absolute 
test  of  the  merits  of  the  schools.  They  emphasized  the  fact 
that  the  examination  measured  intellectual  activity  and  acquire-^ 
ments  only,  and  that  there  are  traits  of  conscience,  respect  for 
order,  religious  sense,  and  the  like  which  might  reverse  the 
ranking  of  the  schools  if  taken  into  account. 
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The  committee’s  interpretations  and  observations,  based  on 
the  examination,  furnish  interesting  and  profitable  reading  for 
the  teacher  of  to-day.  The  Report  of  the  Grammar  School  Commit- 
tee is  reprinted  in  full  by  Caldwell  and  Courtis.  One  not  only 
marvels,  but  actually  thrills  at  the  statements  of  these  Boston 
men  of  1845.  (C.  W.  Caldwell  and  S.  A.  Curtis,  THEN  AND  NOW  IN 
EDUCATION,  1845-1925.  Copyright,  1923,  by  World  Book  Company, 
Publishers,  Yonkers -on-Hud son,  New  York.) 

The  completeness  and  thoroughness  of  this  Boston  Examination 
Iplaces  it  among  the  most  remarkable  incidents  in  the  history  of 
education  in  the  United  States. 
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Summary  of  directions  for  Preparing 


and  Using  Objective  Examinations, 
from 

PREPARATIONS  AND  USE  OF  NEW -TYPE 
EXAMINATIONS  by  Paterson. 


1.  Questions  covering  every  phase  of  the  course  should  be  util- 
ized to  insure  wide  sampling  of  pupil  knowledge. 

2.  An  excess  number  of  questions  should  be  prepared  to  allow 
ample  opportunity  for  the  selection  of  the  best  questions  for 
the  examination  proper. 

3.  Ambiguous  questions  both  with  respect  to  meaning  and  pos- 
sible answer  should  be  rejected. 

4.  The  apparent  difficulty  of  a question  should  not  be  the 
basis  for  either  accepting  or  rejecting  a proposed  question. 


5.  Acceptable  questions  should  include  an  equal  number  of  easy, 
hard,  and  moderately  difficult  questions. 


6.  The  first  half  dozen  or  so  questions  should  be  so  easy  that 
practically  all  can  answer  them,  thus  serving  as  a "shock  absorb 


er . 


7.  Each  acceptable  question  should  be  an  independent  unit  in 
the  examination. 

■ 

o.  Each  acceptable  question  should  be  short. 

! 9.  The  examination  should  include  a very  large  number  of  ques- 
tions. 

i 10.  Each  form  or  type  of  question  should  be  segregated,  the  ex- 
amination consisting  of  as  many  parts  as  there  are  types  of 
questions. 

11.  Within  each  part  of  the  examination  the  questions  should  be 
arranged  according  to  topical  sequence  in  the  course. 

12.  The  examination  itself  should  be  preceded  by  suitable  gen- 
eral directions. 

13.  Specific  directions  should  be  given  for  each  segregated 
group  of  questions. 

14.  There  should  be  a random  arrangement  of  true-false  questions, 
with  approximately  an  equal  number  of  true  and  false  statements. 


13*  The  correct  answers  among  the  alternative  answers  in  the 
single-choice  and  in  the  plural-choice  questions  should  be 
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placed  according  to  chance 


1 6.  A uniform  method  of  marking  the  papers,  together  with  the 
use  of  a colored  pencil  in  scoring,  should  be  used, 

17 • Scoring  formulae  should  not  be  used  except  possibly  for  the 
true-false  type  of  questions,  when  a right-minus -wrong  scoring 
formula  may  be  used. 

18.  "Weighting”  of  questions,  according  to  difficulty  or  impor- 
tance is  rendered  unnecessary  in  new-type  examinations. 

19.  Total  scores  should  be  computed  for  the  examination  papers, 
distributed  on  a graph  or  table,  and  then  a key  for  converting 
total  scores  into  letter  grades  derived. 

20.  The  examination  should  be  mimeographed  or  printed,  and  both 
used  and  unused  copies  should  be  kept  under  lock  and  key  in  or- 
der to  avoid  the  possibility  of  coaching. 

21.  The  prevention  of  coaching  should  also  be  accomplished  by 
using  duplicate  forms  for  classes  in  the  same  subject  taking  the 
examination  at  different  hours  or  on  different  days  and  by  changr 

| ing  the  examination  questions  from  semester  to  semester. 

22.  A large  file  of  questions  should  be  developed  for  each  coursL, 
so  that  a reservoir  of  from  1500  to  2000  objective  questions 
would  be  available  from  which  examinations  in  endless  variety 
could  be  quickly  assembled  and  used  as  occasion  demands.  The 
ideal  plan  is  to  determine  the  diagnostic  significance  of  each 
question,  thus  developing  a large  list  of  valid  questions  to  be 
used  in  the  preparation  of  examinations. 
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History  of  Exams. 


MThe  writer  has  been  using  objective  examinations  since 
1915,  when,  as  an  assistant  in  the  Department  of  Psychology  at 
Ohio  State  University,  he  learned  from  Dr.  A.  P,  Weiss  the  tech- 
nique  involved.  Reference  is  made  in  the  bibliography  to  an  ar- 
ticle published  by  Dr.  Weiss  in  1911,  describing  the  use  of  the 
COMPLETION  TEST  method  of  examining  students  in  introductory 
psychology  at  the  University  of  Missouri.  One  cannot  discover 
the  exact  origin  of  such  methods,  for  they  were  probably  devel- 
oped in  one  form  or  another  in  many  places,  The  present  wide- 
spread interest  shown  in  schools  and  colleges,  of  course,  is  due 
to  the  successful  use  of  objective  examinations  at  Columbia 
University  since  1919,  these  being  made  possible  by  the  ingeniou 

devices  invented  by  Arthur  S.  Otis  and  successfully  utilized  in 

I' 

the  Army  Alpha  intelligence  tests,  which  were  given  to  1,700,000 

| 

draftees  during  the  recent  war.” 


Taken  from  page  42  PREPARATION  AND  USE  OF  NEW-TYPE  EXAMINATIONS 
by  Paterson  (World  Book  Co.  1926.) 


Def.  of  New-Type  Exams. 

One-Word-AnsY/er  Recall  Type 

This  form  requires  as  a correct  answer  a single  word  or 
phrase  to  be  written  by  the  student. 

Completion  Form  of  Recall  Type 

This  form  of  question  originated  as  an  intelligence  test 
many  years  ago,  when  the  German  psychologist  Ebbinghaus  first 
proposed  its  use  as  a psychological  test  method.  It  consists  of 
the  preparation  of  a statement  with  certain  words  omitted,  the 
requirement  being  to  supply  the  missing  words  so  as  to  make  the 
statement  sensible. 
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True-False  Form  of  Recognition  Type 

Discussion  of  this  form  is  deferred,  since  its  significance 
is  better  understood  after  the  discussion  of  the  form  involving 
a choice  among  three  or  more  alternatives. 

Single-Choice  Form  of  Recognition  Type 

This  type  of  question  presents  a statement,  together  with 
several  (usually  four  or  five)  alternative  answers,  only  one  of 
which  is  correct.  The  pupil  is  thus  required  to  exercise  his 
judgment  as  to  the  right  answer  by  underlining  or  otherwise  in- 
dicating which  of  the  several  alternative  answers  he  considers 
to  be  correct.  It  is  a test  of  his  ability  to  recognize  the 
right  answer  and  to  make  a choice  among  several  alternative  an- 
swers . 


True-False  Form  of  Question 

The  True-False  form  of  question  is  the  most  common  of  the 
various  forms  of  the  recognition  type  having  but  two  alternative 
answers.  Among  the  other  forms  is  the  one  involving  a choice 
between  "yes"  and  "no"  as,  for  example,  in  Test  6 of  the  Terman 
Group  Test  of  Mental  Ability,  of  which  the  first  item  is,  "Are 
cartoons  made  by  cameras?  Yes  No."  Another  form  is  that  used  in 
Test  3 of  the  same  Terman  test, 

Alert -sluggish same-opposite 

The  true-false  form  of  question  has  been  used  so  commonly 
in  the  new-type  examinations,  that  many  have  made  the  error  of 
making  no  distinction  between  the  new-type  examination  and  the 
true-false  question.  As  is  evident  from  the  foregoing  descrip- 
tion of  different  kinds  of  new-type  questions,  the  true-false 
kind  must  be  considered  as  only  one  of  many  forms  of  new-type 
questions. 

Plural-Choice  Form  of  Recognition  Type 

This  type  of  question  is  merely  an  extension  of  the  single- 
choice recognition  form.  It  has  been  devised  for  use  where  the 
questions  require  two  or  more  items  in  the  ansv/er.  These  tv/o  or 
more  correct  answers  are  given  along  with  a number  of  unequivo- 
cally wrong  but  seductive  alternatives. 

Pairing  or  Matching  Terms  in  Parallel  Columns 

This  form  has  been  used  only  to  a slight  extent  in  new-type 
examinations  but  is  mentioned  here  because  it  is  admirably  adap- 
ted to  testing  certain  kinds  of  knowledge. 

The  Anology  Form  of  Question 

This  form  is  given  special  mention  because  of  its  difference 
from  the  ordinary  question.  It  is  especially  well  adapted  to 
test  a pupil's  ability  to  see  fundamental  relationships  between 
various  items  studied  in  a course.  The  question  is  based  upon  ar 
analogy  such  as  "Day  is  to  night  as  white  is  to  black."  In  giv- 
ing the  question,  however,  one  of  the  four  terms  (usually  the 
fourth)  is  omitted.  The  pupil  may  be  required  to  supply  the 
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missing  term  making  it  a recall-type  question;  but  usually  four 
or  five  alternative  answers  are  given,  only  one  of  which  is 
correct,  and  the  pupil  is  required  to  choose  the  correct  answer. 
The  anology  form  of  question  is,  therefore,  of  the  recognition 
type. 


Common  Forms  of  New-Type  Questions 
One-Word-answer  recall  type 


Completion  form  of  recall  type 
True-false  form  of  recognition  type 
Single-choice  form  of  recognition  type 
True-false  form  of  question 
Plural-choice  form  of  recognition  type 
Pairing  or  matching  terms  in  parallel  columns 


The  analogy  form  of  question 


Summarized  Definition 

By  way  of  summary,  we  may  characterize  the  old-type  exam- 
ination as  requiring  relatively  long  explanatory  written  answers 
to  a small  number  of  "how"  type  questions,  whereas  the  new-type 
examination  requires  exceedingly  short  answers  to  a relatively 
large  number  of  "key"  questions,  correct  ansy/ers  being  symptom- 
atic of  total  organized  knowledge. 


From  PREPARATION  AND  USE  OF  NEW -TYPE 


EXAMINATIONS  by  Paterson, 


World  Book 
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From  THE  OBJECTIVE  OR  NEW -TYPE  EXAMINATION  by  Ruch 
Pub.  by  Scott,  Foresman  and  Company,  New  York. 

THE  FUNCTIONS  SERVED  BY  EXAMINATIONS 

'’Classification  of  the  purposes  of  examinations.  Although 
a great  many  specific  functions  have  been  claimed  for  the  writte 
examination  by  one  writer  or  another,  these  may  for  present  pur- 
poses be  grouped  as  four,  as  follows: 

1.  Motivation  of  the  learning  of  pupils. 

2.  Maintenance  of  standards  of  accomplishment. 

3.  Training  in  the  use  of  the  English  language. 

4.  Measurement  of  accomplishment. 

Examinations  for  motivation.  It  is  unfortunate  that  we 

_ ■ 

have  so  little  direct  information  as  to  the  motivating  effect  of 
examinations.  That  examinations  do  have  this  value  has  been  tac- 
itly agreed  but  never  proved.  In  spite  of  this  dearth  of  proved 
fact,  it  does  seem  reasonable  to  suppose  that  pupils  strive  for 
somewhat  greater  and  somewhat  more  permanent  mastery  when  they 
realize  that  searching  examinations  may  be  expected  at  a later 
date.  If  this  conclusion  is  true,  certain  reforms  in  the  exam- 
ination system  might  greatly  increase  the  value  of  the  examina- 
tion as  a motivator. 

Maintenance  of  standards  of  work.  Many  school  supervisors 
feel  that  examinations  and  tests  set  by  them  offer  a good  means 
of  control  of  standards  of  work  by  different  teachers.  This  be- 
lief has  led  to  the  practice  of  conducting  uniform  city-, 
county-,  and  state-wide  examinations.  Such  practices  appear  to 
be  losing  ground  slowly,  although  almost  fifty  per  cent  of  the 
individual  states  do  have  uniform  state  examinations  in  at  least 
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the  eighth  grade." 

Copied  verbatim  from  CONSTRUCT  ION  AND  USE  OF  ACHIEVEMENT 
EXAMINATIONS  by  Hawkes,  Lindquist  and  Mann* 

Summary : 

1.  That  the  great  bulk  of  our  present  huge  examining  ac- 
tivity is  achievement  testing,  using  mainly  the  old  essay-type 
examination,  and  devoted  to  the  combined  purposes  of  standards- 
enforcement  and  selection. 

2.  That  the  standards  thus  enforced  are  excellent  and  ben- 
eficial for  one  particular  type  of  boy  and  girl  and  young  man 
and  young  woman,  namely,  those  of  superior  bookish  ability. 

3.  That  those  same  standards,  however,  because  of  their 
uniformity  and  rigidity,  are  thwarting  and  damaging  to  all  other 
kinds  and  degrees  of  capacity. 

4.  That  we  need,  therefore,  to  serve  these  other  kinds  and, 
degrees,  many  more  diversified  standards,  involving  new  kinds  of! 

i courses  and  schools  and  methods  and  disciplines  and  goals. 

5.  That  for  the  demonstration  and  maintenance  of  these  new 
diversified  standards  we  shall  need  a parallel  diversification 
of  achievement  tests,  of  improved  reliability. 

6.  That  with  the  development  of  such  diversification,  how- 
ever, the  major  use  of  examinations  will  come  to  be,  not  the  en- 
forcement of  standards,  but  guidance. 

7.  That  some  parts  of  our  present  standards-enforcement 
examining  are  justifiable,  including  examinations  for  profess- 
ional licensure  and  for  admission,  promotion,  and  graduation  in 
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professional  schools,  endowed  colleges,  and  private  secondary 
and  elementary  schools. 

8.  That  even  in  these  cases  our  present  standards-enfor- 
cing  examinations  need  support  and  correction  from  cumulative  re 
cords  of  many  previous  tests  and  other  data  in  regard  to  the 
students'  careers, 

9.  That  the  enforcement  of  uniform  standards  in  public 
schools  at  any  level  must  be  condemned;  which  is  merely  a corol- 
lary of  (3)  and  (4). 

10.  That  the  alleged  utility  of  examinations  as  an  incen- 
tive to  • study  is  largely  an  illusion  and  rationalization;  at 
best  a minor,  incidental  value  realized  only  in  cases  where  the 
goal  set  is  thoroughly  appropriate  to  the  student's  capacities. 

11.  That  the  utility  claimed  for  examinations  as  a method 
of  instruction  can  be  genuinely  realized  only  when  examinations 
are  used  specifically  for  that  end  and  divorced  from  standards- 
enforcement. 


12.  That  the  utility  of  examinations  for  the  improvement  of 
teaching  is  either  synonymous  with  the  enforcement  of  standards 
or  highly  dubious;  contradicted,  in  fact,  by  claims  that  exam- 
inations tend  to  stultify  teaching. 

13.  That  such  stultifying  will,  however,  tend  to  disappear 
as  we  come  to  use  more  comprehensive  tests,  more  diversified 
standards,  and  cumulative  records. 

14.  That  we  have  not  yet  developed  the  necessary  technique 
for  the  safe  general  use  of  examinations  results  for  the  aonrai- 
sal  of  teachers  or  departments;  but  that  individual  teachers  may 
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profitably  use  such  results  for  self-appraisal  and  self-diagno- 
sis. 

15.  That,  similarly,  testing  procedures  cannot  at  present, 
if  ever,  be  relied  upon  as  a sole  basis  for  the  accrediting  of 
schools  and  colleges,  but  may  constitute  a valuable  item  in  ac- 
crediting, as  contemplated  in  the  new  North  Central  Association 
criteria. 

1 6.  That  the  emergent  major  utility  of  examination  is  edu- 
cational guidance. 

17.  That  the  developing  doctrine  of  guidance  demands,  first, 
diversification  of  standards  and  courses  and  schools,  and,  sec- 
ond, the  general  introduction  of  the  methods  now  available  for 
the  study  of  individuals. 

18.  That  in  examining  for  guidance  we  need  all  known  kinds 
of  tests,  many  of  them,  preferably  comparable  tests,  and  pre- 
ferably tests  used  explicitly  for  this  purpose. 

19.  That  cumulative  records  are  essential  for  the  summation 
and  interpretation  of  personnel  data,  including  test  results  and 
other  relevant  information. 

20.  That  the  general  use  of  examinations  for  guidance  and 
of  cumulative  records  will  ultimately  go  far  towards  solving  the 
problems  of  admission  to  college,  professional  and  other  voca- 
tional guidance,  and  the  needed  diversification  of  standards. 

Copied  verbatim  from  REVIEW  OF  EDUCATIONAL  RESEARCH  p.19-21.1933 


These  discussions  of  the  technical  aspects  of  test  construc- 
tion have  shown  that  the  problem  of  defining  a field  of  subject 
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matter  in  which  general  achievement  is  to  be  measured,  and  the 

problem  of  selecting  elements  of  that  sub jectmatter  for  the  con- 
struction of  items  in  a general  achievement  test,  present  very 
marked  and  signigicant  differences.  The  items  in  a test  do  not 
by  any  means  represent  a random  or  representative  sample  of  the 
content  of  the  field  in  question.  While  every  attempt  should  be 
made  to  make  the  sampling  as  representative  as  possible,  certain 
items  must  be  excluded  because  of  technical  consideration*  What 
the  test  may  contain  is  very  largely  a function  of  what  has  been 
learned  and  of  what  is  the  level  and  range  of  achievement  in  the 
group  to  be  tested.  The  content  of  achievement  tests,  therefore 
cannot  be  expected  to  parallel  the  course  of  study  exactly,  and 
such  examinations  can  neither  be  used  to  ’’check"  nor  be  checked 
by  course  of  study  outlines  directly.  The  problem  of  selecting 
test  items  cannot  be  left  to  the  sub jectmatter  expert  or  to  the 
subjective  judgment  of  any  one  but  is  mainly  a technical  problem 
and  must  be  based  upon  objective  facts  secured  from  actual  trials 
of  numbers  of  items  with  pupils  of  the  kind  to  which  the  com- 
pleted test  is  to  be  administered. 


According  to  Colonel  Parker 

Colonel  Francis  Way land  Parker's  work  was  based  on  a sym- 
pathetic affection  for  children.  This  fine,  vital  emotion  dared 
defy  tradition  and  convention.  False  ideals  had  in  the  past 
made  education  an  inhuman  process.  "Faculties"  were  supposed  to 
be  developed  by  a dull  mechanical  routine  of  teaching.  The  re- 
sult was  intellectual  and  moral  anaemia.  Colonel  Parker  wanted 


> 


. 


- 

* 

. 

- 

. 


" 

. 

* 

* 

- 


151 


to  replace  these  artificial  supports  by  simple,  natural  methods. 
His  work  was,  above  all,  human work  that  dealt  with  human  soul 

Colonel  Parker  was  born  Oct.  9,  1831  at  Bedford,  New  Hamp- 
shire. He  began  teaching  at  the  age  of  sixteen.  He  made,  first 
of  all,  an  appeal  to  the  interest  and  enthusiasm  of  the  children 
This  necessitated  the  abandonment  of  the  textbook  method  of 
teaching  and  the  development  of  a new  skill  in  presenting  the 
lesson.  He  believed  that  number  should  be  taught  by  the  objec- 
tive method. 

Next  to  the  text-book,  the  greatest  obstacle  in  the  way  of 
real  teaching  was  the  standard  of  examinations.  Examinations 
were  usually  given  simply  to  test  the  pupil’s  power  of  memori- 
zing disconnected  facts.  They  should  test  the  conditions  and 
progress  of  mental  growth  in  the  children.  Moreover,  perfect 
freedom  should  be  given  the  teacher  to  do  the  best  work  in  her 
! own  way  without  regard  for  false  standards. 

Francis  Wayland  Parker  was  a brilliant  apostle  of  the  New 
Education.  He  introduced  many  reforms  that  seemed  radical  in 
his  time,  but  which  are  now  generally  practiced  by  the  schools. 
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American  Book  Co.,  300  Pike  St.,  Cincinnati,  Ohio. 

American  Classical  League,  care  of  Dr.  Mason  D.  G-ray,  East  High 
School,  Rochester,  N.  Y. 

American  Library  Association,  86  East  Randolph  St.,  Chicago,  111. 
Edward  E.  Babb  and  Co.,  212  East  Summer  St.,  Boston,  Mass. 

Berry  and  Co.,  Chicago,  111. 

C.  C.  Birchard  and  Co.,  Boston,  Mass. 

Milton  Bradley  and  Co.,  Springfield,  Mass. 

Brigham  Young  University,  Provo,  Utah. 

Bruce  Publishing  Co. , Milwaukee,  Wisconsin. 

Bureau  of  Public  Personel  Administration,  Mills  Bldg.,  Pennsyl- 
vania Ave.  and  Seventeenth  St.,  Washington,  D.  C. 

Business  Standards  Association,  299  Broadway,  New  York  City. 
Carnegie  Institute  of  Technology,  Pittsburgh,  Pa. 

Catholic  Education  Press,  1326  Quincy  St.,  N.E.  Brookland  Station, 
Washington,  D.  C. 

Center  for  Psychological  Service,  202-4  nGH  St.,  N.W.,  Washington, 

D.  C. 

College  Bookstore,  Columbus,  Ohio. 

Colorado  State  Norman  School,  Gunnison,  Colo. 

Columbia  University,  525  West  one-hundred- twentieth  St.,  N.Y.C. 
Committee  on  Social  and  Religious  Survey,  307  Seventh  St., N.Y.C. 
Constitution  Publishing  Co.,  Mitchell,  S.  D. 

Department  of  Interior,  Bureau  of  Education,  Washington,  D.  C. 

The  Dobson-Evans  Co.,  Indianapolis,  Ind.,  or  Columbus,  Ohio. 

George  H.  Doran  Co.,  New  York  City. 

Eau  Claire  Book  and  Stationery  Co.,  Eau  Claire,  Wis. 

Educational  and  Personnel  Publishing  Co.,  P.  0.  Box  1039, 
Washington,  D.  C. 

Educator  Supply  Co.,  Mitchell,  S.  D. 

Gage  and  Co.,  Ltd.,  London,  England. 

Ginn  and  Co.,  2301-2311  Prairie  Ave.,  Chicago,  111.,  or  15  Ash 
burton  P^ace,  Boston,  Mass. 

The  Gregg  Publishing  Co.,  20  West  Forty-seventh  St.,  New  York 
City,  or  623-633  South  Wabash  Ave.,  Chicago,  111.,  or 
Statler  Bldg.,  Boston,  Mass.,  or  Phelan  Bldg.,  San  Francis-j 
co,  Calif.,  or  285  Fifth  Ave.,  New  York  City. 

Hall  and  McCreary  Co.,  432  South  'Vabash  Ave.,  Chicago,  111. 

J.  L.  Hammett  Co.,  Newark,  N.  J.,  or  Cambridge,  M§ss. 

G.  G.  Harrap  and  Co.,  London,  England 
Harris  Teachers  College,  St.  Louis,  Mo. 

Harvard  University,  Cambridge,  Mass. 

Harvard  University  Press,  Cambridge,  Mass. 

D.  C.  Heath  and  Co.,  1815  Prairie  Ave.,  Chicago,  111. 

Hollins  College,  Hollins,  Va. 

Henry  Holt  and  Co.,  1 Park  Ave.,  New  York  City. 

Houghton  Mifflin  Co.,  New  York  City. 

Hub  City  Supply  Co.,  20  Third  Ave.,  S.E.,  Aberdeen,  S.  D. 

Indiana  University,  Bloomington,  Ind. 

Institute  of  Public  Service,  1125  Amsterdam  Ave.,  N.  Y.  C. 

Iowa  State  Teachers  College,  Cedar  Falls,  Iowa. 
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The  John  Hopkins  Press,  Baltimore,  Md. 

Kansas  State  Normal  School,  Emporia,  Kan. 

Kenyon  Press  Publishing  Co.,  Wauwatosa , "ris. 

Lafayette  Publishing  Co.,  Lafayette,  Ind. 

Laidlaw  Brothers,  2001  Calumet  Ave.,  Chicago,  111.,  or  118  East 
Twenty -fifth  St.,  N.  Y.  C. 

The  Lakeland  Publishing  Co.,  217  North  Mills  St.,  Madison,  Wis. 

Laurel  Book  Co.,  Chicago,  111. 

J.  B.  Lippincott  Co.,  Chicago,  111.,  or  227  South  Sixth  St., 
Philadelphia,  Pa. 

McKnight  and  McKnight,  Normal,  111.,  or  Columbus,  Ohio, 

The  McMillan  Company,  60  Fifth  Ave.,  N.  Y.  C.,  or  30  Huntingdon 
Ave.,  Boston,  Mass.,  or  Prairie  Avenue  and  25th  St.,  Chicag 
111.,  or  330  South  Harvard  St.,  (P.O.Box  1151,  Dallas,  Tex. 
or  17  Houston  St.,  Atlanta,  G-a,,  or  350  Mission  St.,  San 
Francisco,  Calif. 

The  Manual  Arts  Press,  Peoria,  111. 

National  Council  of  Teachers  of  English,  6705  Yale  Ave.,  Chicago 

111. 
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National  Publishing  Society,  Mountain  Lake  Park,  Md, 

The  National  Society  of  Teachers  of  English,  506  West  Sixty- 
ninth  St.,  Chicago,  111. 

Normal  Bookstore,  Cheney,  Wash. 

Northwestern  State  Teachers  College,  Alva,  Okla. 

Northwestern  University,  Evanston,  111. 

Oberlin  College,  Oberlin,  Ohio. 

Ohio  State  University,  Columbus,  Ohio. 

A.  N,  Palmer  Co.,  Chicago,  111. 

The  Parker  Co.,  Madison,  Wis. 

Oeorge  Peabody  College  for  Teachers,  Nashville,  Tenn. 

Playground  and  Recreation  Assn,  of  America,  1 Madison  Ave.,N.Y.C. 
The  Plymouth  Press , ‘ 7850-56  Lowe  Ave.,  Chicago,  111. 

Prang  Co.,  Chicago,  111. 

Public  School  Publishing  Co.,  Bloomington,  111. 

Purdue  University,  Lafayette,  Ind. 

Rand  McNally  and  Co.,  Chicago,  111. 

Research  Publishing  Co.,  Washington,  D.  C. 

Research  Service  Co.,  4259  South  Van  Buren  Place,  Los  Angeles, 
Calif. 


Research  University,  Washington,  D.  C. 

Russell  Sage  Foundation,  130  East  Twenty-second  St.,  N.Y.C. 
Scott,  Foresman  and  Co.,  623  South  Wabash  Ave,  Chicago,  111. 
Silver,  Burdett  and  Co.,  Boston,  Mass. 

Smith,  Hammond,  And  Co.,  Atlanta,  G-a. 

South-Western  Publishing  Co.,  Chicago,  111. 

Christopher  Sower  Co.,  6l4  Arch  St.,  Philadelphia,  Pa. 
Leland  Stanford  University,  Stanford,  Calif. 

State  Manual  Training  Normal  School,  Pittsburg,  Kan. 

State  Normal  School,  Indiana,  Pa. 

State  Normal  School,  Plymouth,  N.  H, 

State  Teachers  College,  Santa  Barbara,  Calif. 

C.  H.  Stoelting  Co.,  424  North  Homan  Ave.,  Chicago,  111. 
University  of  Alberta,  Edmonton,  Canada. 
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University  of  Chicago,  Chicago,  111. 

University  of  Chicago  Bookstore,  5802  Ellis  Ave.,  Chicago,  111. 
University  of  Chicago  Press,  Chicago,  111. 

University  of  Cincinnati,  Cincinnati,  Ohio. 

University  Cooperative  Co.,  504  State  St.,  Madison,  Wis. 
University  of  Illinois,  Urbana,  111. 

University  of  Iowa,  Iowa  City,  Iowa. 

University  of  Minnesota,  Minneapolis,  Minn. 

University  of  Nebraska,  Lincoln,  Neb. 

University  of  North  Carolina,  Chapel  Hill,  N.  C. 

University  of  Oklahoma,  Norman,  Okla. 

University  of  Oregon,  Eugene,  Ors. 

University  of  Pennsylvania,  Philadelphia,  Pa. 

University  of  Pittsburgh,  Pittsburgh,  Pa. 

University  Print  Shop,  Lewisburg,  Pa. 

University  Publishing  Co,  Chicago,  111. 

University  Supply  and  Book  Co.,  10109  Wilbur  Ave.,  Cleveland, Ohio. 
University  of  Texas,  Austin,  Texas. 

University  of  The  State  Of  New  York  Press,  Albany,  N.  Y. 

University  of  Toronto  Press,  Toronto,  Canada. 

University  of  Wisconsin,  Madison,  Wis. 

University  of  Wyoming,  Laramie,  Wyoming. 

U.  S.  Bureau  of  Education,  Washington,  D.  C. 

U.  S.  Civil  Service  Commission,  Washington,  D.  8. 

West  Intermediate  Press,  Jackson,  Mich. 

West  Publishing  Co.,  St.  Paul,  Minn. 

Western  Reserve  University,  Cleveland,  Ohio. 

Western  State  Normal,  Kalamazoo,  Mich. 

YHiittier  State  School,  Shittier,  Calif. 

Winnetka  Individual  Materials,  Inc.,  Horace  Mann  School, 

Winnetka,  111. 

World  Book  Co.,  Yonkers-on-Hudson,  N.  Y. , or  2126  Prairie  Ave., 
Chicago,  111.,  or  Boston,  Mass.,  or  San  Francisco,  Calif., 
or  Dallas,  Tex.,  or  Portland,  Ore.,  or  Atlanta,  Ga.,  or 
Manila,  P.  I. 

Yale  University,  New  Haven,  Conn. 

Zaner  and  Bloser  Co.,  118  North  High  St.,  Columbus,  Ohio. 
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New  York,  Inor  Publishing  Company.  1934-. 

Allen,  W.  S., 

A Study  in  Latin  Prognosis.  Teachers  College,  Contribution 
to  Education,  No.  135,  1923  40pp. 

Alltucker,  M.  M. , 

"is  the  Pedagogically  Accelerated  Student  a Misfit  in  the 
Senior  High  School?"  School  Review  32:  193-202,  March, 

1924. 

Almack,  J.  C.  and  Lang  A.  R., 

Problems  of  the  Teaching  Profession,  pp.  183-85. 

"The  true  efficiency  of  a teacher,  however,  should  be 
thought  of  in  terms  of  service  rendered  to  students.  The 
best  teacher  is  really  the  one  under  whom  students  make  the 
greatest  progress.  From  this  viewpoint  the  student-test 
method  for  measuring  teaching  efficiency  is  the  most  prom- 
ising. By  this  method  tests  are  given  to  the  students  at 
the  beginning  and  again  at  the  end  of  certain  periods  of 
work,  and  the  teacher  receives  credit  for  the  progress  made 
Such  a procedure  must  be  used  w ith  caution,  because  many 
factors  may  enter  into  consideration  which  are  beyond  the 
teacher's  control." 

Almack,  J.  and  Lang,  A.  R. , 

The  Beginning  Teacher,  pp.  225-26. 

Almack  and  Lang  give  the  following  advantages  which  new- 
type  examinations  possess: 

"They  avoid  opinion  in  scoring. 

They  obviate  ambigous  answers. 

They  obviate  irrelevant  responses. 

They  provide  fine  scoring  units. 

The  units  are  standardized. 

Irrelevant  factors  do  not  affect  the  score. 

They  are  easy  to  take  and  to  mark. 

Standards  can  be  developed  from  them. 

They  are  interesting. 

They  are  adaptable." 
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Anderson,  C.  J., 

MIs  the  Exemption  System  "forth  While?"  in  School  and 
Society,  Vol.  3,  pp. 357-60.  March  4,  1916. 

"Some  investigators  have  studied  the  effect  of  ex- 
emption system  upon  scholarship.  They  found  that  the  ex- 
emption system  does  not  materially  affect  the  quality  or 
amount  of  work  done,  that  the  supposed  improvement  in 
scholarship  is  often  more  apparent  than  real."  Lang. 


Lang  is  referring  here  to  Anderson  and  also  to  H.  Kimmel. 
Arnold,  H.  L. , 

"Analysis  of  Discrepancies  Between  True-False  and  Simple 
Recall  Examinations,"  Journal  of  Educational  Psychology. 
Vol.  18,  pp.  414-420.  1927. 

A shbaugh , E.  J . , 

"Reducing  the  Variability  in  Teachers’  Marks,"  Journal  of 
Educational  Research,  Vol.  9,  pp.  185-198.  1924 

Asker.  William, 

"The  Reliability  of  Tests  Requiring  Alternative  Responses." 
Journal  of  Educational  Research,  Vol.  9,  No. 3,  Pages  234- 
24l.  March  1924. 

Analyzes  the  two-alternative  (true-false  type)  and 
the  three-alternative  (recognition  type)  tests  on  the  bas^ 
of  experiment  and  mathematics  and  finds  that  a completely 
ignorant  person  has  a very  small  chance  of  obtaining  a 
passing  mark.  Urges  discouraging  of  guessing  and  recog- 
nizes the  need  for  a more  reliable  method  of  scoring  such  j 
tests. 

Ref.  and  quotation  taken  from  Preparation  and  Use  of  New- 
Type  Examinations,  by  Paterson. 

Atkins,  Blanche  E.  and  Arkins,  Ruth  E. , 

"A  study  of  the  Honesty  of  Prospective  Teachers,"  The 
Elementary  School  Journal,  XXXVI.  (April,  1936)  pp.595- 
604 . 


s 


The  author  presents  the  results  of  an  experimental 
study  of  the  honesty  of  teacher's  college  students  from 
which  they  conclude  that  the  proportion  of  students  who 
are  dishonest  in  tests  is  in  direct  relation  to  the  pro- 
cedure of  the  teacher. 

Ayers.  L . P . , 

"History  and  Present  Status  of  Educational  Measurement," 
in  Seventeenth  Yearbook  of  National  Soc  iety  for  the  Study 
of  Education,  part  2,  chapter  1.  1918. 

Baldwin, 

Some  Faults  Common  in  Informal  Objective  Tests  Made  by 
High  School  Teachers.  E* . Adm.  & Super.  Vol.  14.  No. 2. 

Feb.  1928. 

The  new  type  examination  is  gaining  ?/ide spread  pop- 
ularity as  an  instrument  of  measurement  in  the  high  school. 
Slight  but  recurrent  errors  found  in  tests  in  regards  to 
constructing  and  selecting  items. 

Ball,  Rouse  W.  W., 

Original  and  History  of  the  Mathematical  Trioos  ( Cambridge J 
1880) . 


160 


Ballard,  P.  B. , 

The  New  Examiner.  London,  Hodder  and  Stoughton,  1934.266pp. 

An  unusually  well  written  and  early  discussion  of  old- 
and  new-type  examinations,  with  special  attention  to  the 
examination  as  a measuring  instrument. 

Ballard,  P.  B. , 

The  New  Examiner,  pp. 96-98.  (1924.) 

"Ballard  found,  after  study  and  a re-test,  that  stu- 
dents show  greater  improvement  on  the  false  statements  thari 
on  the  true  statements.  The  objection  to  true-false  tests 
on  the  grounds  that  they  give  false  impressions  is  not  well 
founded. " 

Ballon,  Frank  W. , 

Improving  Instruction  Through  Educational  Measurement.  E^. 
Admin.  & Supervision.  Vol.2,  No. 6.  June  1916. 

Aim  of  Educational  Measurement  is  improvement  of 
Instruction. 

Banker,  H.  J., 

"Significance  of  Teachers'  Marks,"  Journal  of  Educational 
Research,  Vol.  16,  pp.  159-171  and  271-284.  1927. 

A discussion  of  marks  and  marking  systems. 

Bardy,  J., 

"An  Investigation  of  the  Written  Examination  as  a Measure 
of  Achievement  with  Special  Reference  to  General  Science". 
University  of  Pennsylvania,  1923. 


Barr,  A.  S., 

"The  Measurement  of  Teaching  ABility,"  Journal  of  Educa- 
tional Research,  XXVIII  pp.  561-9.  April,  1935. 

pp. 443-454  supplies  information  concerning  the  uses 
of  tests  and  measurements  in  China,  England,  France  and 
Germanv . 


Barr , A . S . , 

"Measurement  in  the  supervision  and  Improvement  of  Teach- 
ing. Twenty-second  Conference  on  Educational  Measurement, 
pp.  25-31. 

Barthelmess,  H.  M. , 

"Reply  to  Criticism  of  Tests  Requiring  Alternative  Respons- 
es." Journal  of  Educational  Research,  Vol. 6,  No. 4,  pages 
357-359.  November  1922. 

Denies  the  validity  of  criticisms  directed  against 
true-false  tests  and  affirms  that  they  do  have  genuine 
pedagogical  value. 

Bateson,  Mary, 

"Mediaeval  England"  England  Feudal  Society  from  the  Norman 
Conquest  to  the  Middle  of  the  Fourteenth  Century. 

Pub.  by  G.  P.  Putnam  Sons,  London.  1904. 


Batson 

11 


Realiability  of  the  True-False  Form  of  Examination. 
Educational  Administration  and  Sunervision,  Vol.  10,  oagesd 
95-103.  1924. 

Describes  an  experiment  using  four  true-false  examin- 
ations and  four  essay  examinations  in  a course  in  element- 
ary education  concluding,  "Results  obtained  by  the  True- 
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False  Examination  conform  sufficiently  to  those  obtained  by 
the  regular  examination  to  make  it  possible  for  the  True- 
False  Examination  to  be  substituted  for  the  essay  examina- 

tion. " 

Bawden,  W.  T., 

"The  Army  Trade  Tests," 

U.  S.  Eureau  of  Education  Circular,  No.  4,  April,  1919. 28pp 
Beier,  Adolph, 

Die  hiJheren  Schulen  in  Preussen  und  ihre  Lehrer  (1902-1906) 
(in  progress) 

Benz,  Harry  Edward, 

...The  efficiency  book  for  high  schools,  by  H.  E.  Benz... 
and  F.  B.  Knight.. .New  York,  Chicago  (etc.)  Rand,  McNally 
and  Co.,  1929. 

Berg,  0., 

"Construction  of  Tests  on  Silas  Marner,"  University  High 
School  Journal,  Oakland,  California,  Vo.  7,  pp.  304-317, 
1928. 

Bernstein,  L. , 

"A  New-Type  Examination  in  History,"  New  York  Bulletin  of 
High  Points,  pp.  15-20,  March,  1923. 

Betts,  George  Herbert, 

The  Recitation,  1910.  Testing  deals  with  ground  already 
covered,  matter  learned,  or  powers  derived  - to  find  out 
what  child  knows,  or  what  he  can  do  of  that  which  he  has 
already  been  over  in  his  work.  Every  new  lesson  in  some 
measure  is  a test. 

Bibliography  of  Educational  Measurements, 

Second  Revision,  by  Smith  and  Wright,  Pub.  by  Bureau  of 
Cooperative  Research,  Indiana  University,  Bloomington,  Ind. 
Vol.  IV  No.  2.  November,  1927. 

It  contains  ref.  to  English,  Mathematics,  Reading,  Social 
Studies,  Handwriting,  Foreign  Language,  Science,  Commercial 
Special  Subjects,  Tests  in  other  Fields,  and  Intelligence. 
Binet  and  Simon, 

A METHOD  OF  MEASURING-  THE  DEVELOPMENT  OF  YOUNG  CHILDREN 
(Chicago,  1913) 

Bingham,  W.  V., 

"Measuring  a Workman's  Skill;  the  Use  of  Trade  Tests  in 
Army  and  Industrial  Establishments,"  Proceedings  of  the 
National  Society  for  Vocational  Education,  Bulletin  30,1919 
Bird,  C., 

"The  Detection  of  Cheating  in  Objective  Examinations," 

School  and  Society,  Vol.25,  pp.  261-262,  1927. 

Bird,  Charles, 

"The  Detection  of  Cheating  in  Objective  Examinations";  in 
School  and  Society,  Vol.  5,  pp.  261-262.  (February  26,1927 
"Bird  gives  an  illustration  of  this  method  for  the  detection 
of  cheating  in  an  objective  test... By  statistical  procedures 
the  probable  chances  of  each  student's  cheating  can  be  cal-, 
culated.  The  new-type  test  makes  it  possible  to  detect 
cheating  with  mathematical  certainty.  The  certainty  of  de- 
tection and  conviction  should  in  itself  be  an  important  fac 
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tor  in  the  prevention  of  cheating,” 

Eixler,  Harold  H., 

Check  Lists  for  Educational  Research, 

Bureau  of  Publications,  Teachers  College,  Columbia  Univer- 
sity, ll8pp, , 1928, 

Bliss.  D,  C., 

"High  School  Failures,”  Educational  Administration  and 
Supervision,  Vol,  3,  pp.  125-138,  1917* 

Bliss , Don  C. , 

School  Measurements  and  School  Administration,  Ed.  Admin, 
and  Supervision  Vol,  1,  No.  2.,  Feb.  1915. 

The  general  interest  in  standard  measurements  found  in  all 
school  circles  marks  a forward  step  in  educational  practice 
because  these  measurements  provide  in  place  of  a subjective 
standard,  an  objective  one  which  is  equally  valuable  to  the 
superintendant  in  formulating  a general  school  policy  and 
to  the  teacher  in  carrying  on  the  daily  work  of  the  class- 
room. 

Blumer,  G-., 

"Desirability  of  Changing  the  Type  of  Written  Examinations, 
Journal  of  the  American  Medical  Association,  Vol.  62,  pp. 
1131-1133,  1919. 

Elumer,  G-. , 

"Desirability  of  Changing  the  Type  of  Written  Examinations, 
Journal  of  American  Medical  Association,  Vol.  72,  pages 
1131-1133,  1919. 

Argues  against  the  traditional  medical  examinations  as  mere 
memory  tests  and  proposes  to  adopt  objective  technique, 
developed  by  the  psychologists,  in  the  preparation  of  med- 
ical examinations. 

Bolton,  F.  E. , 

"Do  Teachers’  Marks  Vary  as  Much  as  Supnosed?"  Education 
Vol.  48,  pp.  23-39,  1927. 

An  attempted  refutation  of  Starch's  claim  that  teachers' 
marks  vary  enormously  on  the  same  paper. 

Boraas,  J.,  and  Selke,  G-.  A., 

Rural  School  Administration,  chapters  xviii,  xix,  Yonkers- 
on-Kudson,  1926. 

Boring,  E.  G-. , 

’’The  Logic  of  the  Normal  Law  of  Error  in  Mental  Measuring,” 
American  Journal  of  Psychology,  Vol.  31,  pp.  1-33,  1920. 
Bovet,  P., 

Les  examens  de  recrues  dans  l'arm6e  Suisse  1854-1913. 
Neuchatel  and  Paris  Editions  Delachauy  and  Niestl&,  n.d. 
(Collection  d'actualit&s  p^dagogiques ) , (XVI,  218  p.o.) 

Boyd,  W., 

"Exploration  of  the  True-False  Method  of  Examination,” 

Forum  of  Education,  Vol.  4,  pp.  34-38,  1926. 

Branom,  M.  E. , 

The  Measurement  of  Achievement  in  G-eography,  N.  Y. , The 
Macmillan  Company,  186  pp. , 1925. 

Breed,  Frederick  S., 

A Method  of  Classifying  Pupils,  El.  S.  J.  Vol.  30,  Sept. 1929. 
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In  his  treatment  of  classification  in  an  earlier  book, 
Professor  Wm.  A.  McCall  placed  chief  reliance  in  achieve- 
ment tests  and  used  scores  in  the  form  of  educational  age. 
In  the  present  book  bo  th  intelligence  and  achievement  tests 
are  used,  and  G (grade)  scores,  combining  the  results  of 
both. 

Breeze,  R.  E. , 

"Correcting  Examination  Papers,"  School  Review,  Vol.  30, 
pp.  57-62.  1925 

Brereton,  Cloudesley, 

"A  New  Method  of  awarding  Scholarships,"  School  World,  pp. 
409.  1907. 

Briggs,  T.  H., 

An  Examination  in  First-Year  Latin,  The  Classical  Weekly, 
Vol.  16,  No.  19.  1923. 

Briggs,  T.  H., 

"A  Dictionary  Test,"  Teachers  College . Record,  Vol.  24,  pp. 
355-365.  1923. 

Good  suggestions  for  constructing  tests  on  the  use  of 
the  dictionary • 

Briggs,  Thomas  H. , Chassell,  Clara  F.,  Upton,  Siegr  Maio., 
Chassell,  Laura  A., 

"AN  ENGLISH  FORM  TEST".  Short  Scales  for  Measuring  Habits 
of  good  citizenship.  1922.  Teachers  College  Record. 

Brinkley,  S.  4 . f 

"Values  of  the  New-Type  Examinations  with  Special  Reference 
to  History." 

Brinkley,  S.  G. 

"Values  of  New-Type  Examinations  in  the  High  School  with 
Special  Reference  to  History,"  Teachers  College,  Columbia 
Univ.  Contributions  to  Education,  No.  161,  1924. 

An  experimental  study  of  assay  and  objective  tests 
over  the  same  ground  in  history,  tending  to  prove  that 
neither  type  in  measurably  superior  under  comparable  con- 
ditions. 

Brooks,  S.  S., 

Improving  Schools  by  Standardised  Tests,  Boston,  Houghton 
Mifflin  Company,  pp.273.  1922. 

A very  elementary  but  practical  discussion  of  the 
values  of  educational  tests. 

Brown,  C.  M. , 

"What  Can  Educational  Measurements  Do  for  Home  Economics?" 
Journal  of  Home  Economics,  Vol.  16,  pp. 191-196.  1924. 

Brown.  C.  M. , 

"Construction  and  Use  of  Information  Tests  in  Home  Econom- 
ics," Journal  of  Home  Economics,  Vol.  16,  pp. 251 -256.  1924 

Brueckner,  E.  0., 

Diagnostic  and  Remedial  Teaching,  Houghton  Mifflin  Co.,  N. 
Y.  1931. 

Buckingham,  B.  R. , 

Research  for  Teachers,  Chapter  VI.  Boston,  1926. 

Buckingham,  B.  R. , Doherty,  Margaret,  MacLatchy,  Josephine, 
Bibliography  of  Educational  and  Psychological  Tests  and 
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Measurements.  U.  S.  Bureau  of  Ed.  Bulletin,  No.  55.  1923. 
Pp.233.  Washington,  1924. 

Buckner,  C.  A.  and  Hughes,  R.  0., 

"Testing  Results  in  the  Social  Studies,"  Journal  of  the 
School  of  Education,  University  of  Pittsburgh,  Vol.  1,  No. 
1,  pp.5-11.  1925. 

Buckner,  C.  A.  and  Hughes  R.  0., 

"Testing  Results  in  Social  Studies,"  University  of  Pitts- 
burgh, School  of  Education  Journal,  Vol.l,  No.l.  pd.5-12. 
1925. 

Buisson,  F., 

Dictionnaire  de  Pddagogie  (1880-1887). 

Burgess,  May  Ayres, 

Classroom  Grouping  for  Silent-Reading  Drill,  El 
al  Vol. 22.  Dec.  1921.  Pp. 269-278. 

The  educational  test  is  of  use  to  the  classroom  teache 
if  it  tells  her  what  each  child  can  do  at  the  time  of  test- 
ing, if  it  suggests  what  sort  of  treatment  he  needs  to  make 
him  do  better,  and  if  it  makes  possible  further  testing  at 
later  periods  to  discover  the  progress  he  is  making. 

Buros,  Oscar  K. , 

Bibliography  of  standardized  tests,  occupational  devices, 
and  record  forms  published  in  1933  and  1934.  New  Brunswick 
N.  J.,  Department  of  education  Rutgers  University.  1934. 
Bursnh,  J.  F.  and  Meltzer,  H.  M. , 

"The  New  Examination,"  School  of  Vocational  Education, 
Oregon  Agricultural  College,  Corvallis,  Oregon,  Bulletin 
No.  422,  Sept.  1926. 

Discusses  the  characteristics  of  a good  examination 
and  gives  a number  of  sample  tests. 

Burton,  William  H., 

"A  Contribution  to  Technique  of  Constructing  'Best  Answer 
Tests.'"  Elementary  School  Journal  25:762-300,  Vol.  22, 
June,  1925. 

3utler,  W.  F. 

"The  Value  of  Informal  Tests  in  Supervision,"  The  First 
Yearbook,  Elementary  School  Principals,  pp.  94-119.  1924. 

Caldwell,  0.  W.  1 Curtis,  S.  A., 

Then  and  No w in  Education,  1845-1923.  Copyright,  1923,  by 
7/orld  Book  Company,  Publishers,  Yonkers -on -Hudson,  New  York 
"One  not  only  marvels,  but  actually  thrills  at  the 
statements  of  these  Boston  men  of  1845.  The  completeness 
and  thoroughness  of  this  Boston  examination  places  it  among 
the  most  remarkable  incidents  in  the  history  of  education 
in  the  United  States." 

"The  committee's  interpretations  and  observations, 
based  on  the  examination,  furnish  interesting  and  profitabl 
reading  for  the  teacher  of  to-day." 

Camp,  F.  S., 

"Some 'Marks, 'an  Administrative  Problem,"  School  Review,  Vol 
25,  pp.  697-713.  1917. 

Campbell,  William  Giles, 

A comparative  investigation  of  behavior  of  students  under 
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an  honor  system  and  a proctor  system  in  the  same  University. 
Los  Angeles,  California.  1935.  The  U.  of  Southern  Cal. 
press. 

Carlson,  P.  A. , 

"Tests  and  Measurements  in  Bookkeeping,  Bulletin  of  the 
Whitewater  State  Normal  School,  Whitewater,  Wisconsin,  Vol. 
11  No.  1,  Bulletin  No.  119,  pp.3-9.  1925. 

The  Southwestern  Publishing  Company  of  Cincinnati, 

Ohio,  Publishes  a number  of  commercial  tests  devised  by  Mr. 
P.  A.  Carlson. 

Carlson,  P.  A., 

"A  Test  Program  in  Bookkeeping,"  The  Balance  Sheet,  Vol.  7j 
No.l.  pp.  12-14 . 1925. 

Carroll,  Robert  ?., 

"Methods  of  Educational  Research."  Journal  of  Educational 
Research,  11:309-11,  April,  1925. 

Caswell,  Hollis  Leland, 

City  School  Surveys.  Contributions  to  Education,  No.  358 
New  York:  Teachers  Columbia  University,  pp.  130.  1929. 

Cattell , J.  McK., 

"Examinations,  Grades,  and  Credits,"  Popular  Science  Month- 
ly, Vol.  66,  pp.  367-378.  1905. 

Cattell,  James  McKeen, 

Popular  Science  Monthly,  Pub.  in  1905. 

Champneys,  Mrs.  Mary  C., 

...An  English  bibliography  of  examinations  (1900-1932)  by 
Mary  C.  Champneys;  with  a foreword  by  Sir  Michael  Sadler 
and  Sir  Philip  Hartog,  London,  Macmillan  and  Co.,  Lratd.1934 
Notes  of  periodicals  which  have  been  scanned. 

Chapman,  H.  B., 

Organized  Research  in  Education  with  Special  Reference  to 
the  Bureau  of  Educational  Research.  Bureau  of  Educational 
Research  Monograph,  No.  7.  Columbus,  Ohio:  Ohio  State 

University.  Pp.  221.  1927 

i Chapman,  J.  Crosby., 

"Some  Elementary  Statistical  Considerations  in  Educational 
Measurements."  Journal  of  Educational  Research  4:212-20, 
Oct.  1921. 

Chapman,  J.  C.,  and  Toops,  H.  A., 

"A  Written  Trade  Test:  Multiple-Choice  Method."  Journal 

of  Applied  Psychology,  Vol.  3,  No. 4,  Pages  358-365.  1919. 

An  experimental  demonstration  of  the  adaptation  of 
the  oral  trade -test  method  to  the  examination  of  a group 
of  individuals  by  means  of  a printed  trade  test,  the 
answers  being  written  on  the  examination  sheet. 

Chapman,  J.  C., 

Trade  Tests.  Henry  Holt  & Co.,  N.  Y;  1921.  ix  435  pages. 

A detailed  account  of  the  work  of  the  United  States  Army 
Trade  Test  Division  of  the  Committee  on  Classification  of 
Personnel  in  the  Army.  This  book  is  especially  valuable 
for  the  excellent  presentation  of  the  principles  underlying 
standardized  trade-test  technique  in  which  the  traditional 
i 
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multi -answer  questions  are  contrasted  with  the  new  single-  j1 
answer  questions. 

Chapman,  J.  C., 

"individual  Injustice  and  G-uessing  in  the  True-False  Exam- 
ination," Journal  of  Applied  Psychology,  Vol.  6,  pp.  342- 
348,  1922. 

Another  protest  against  assuming  that  a right-minus- 
wrong  scoring  formula  for  true-false  tests  counteracts  the 
effects  of  guessing  and  results  in  accurate  scores  for  each 
individual.  "With  other  forms  of  examination,  such  as  the 
single-word-answer  or  completion  type,  the  evils  which  ac- 
company guessing  do  not  enter." 

Chapman,  J.  C., 

"The  Measurement  of  Physics  Information, " School  Review, 

Vol.  27,  pp.  748-756,  1919. 

Describes  the  development  and  trial  of  a thirty -ques- 
tion objective  test  in  high  school  physics  utilizing  the 
one-word-answer  method. 

Charters,  W.  W., 

"Success,  Personality*  and  Intelligence,"  Journal  of  Educa- 
tional Research,  Vol.  XI,  November,  1925. 

Charters,  W.  W, 

"A  Technique  for  Trait  Analysis,"  Journal  of  Educational 
Research,  Vol.  X.  September,  1924. 

Charters,  W.  W., 

"Constructing  a Language  and  Grammar  Scale,"  Journal  of  Edu- 
cational Research,  Vol.  1,  pp.  249-258,  1920. 

An  account  of  the  validation  of  language  tests  of  the 
standardized  variety, 
i Chase,  Stuart,  and  F.  J.  Schlink, 

Your  money's  worth;  a study  in  the  waste  of  the  consumer's 
dollar,  Macmillan  Co.,  N.  Y. , 1927. 

Chassell,  C.  F.  and  E.  B., 

"A  Test  and  Teaching  Devise  in  Citizenship  for  Use  in  Jun- 
ior High  Schools,"  Educational  Administration  and  Super- 
vision, Vol.  10,  pp.  7-29,  1924. 

Cheydleur,  F.  D., 

"Construction  and  Validation  of  a French  G-rammar  Test  of 
the  selection  and  Multiple-Choice  Type,"  Journal  of  Educa-  ;! 
tional  Research,  Vol.  17,  pp.  184-196,  1928. 

Another  good  account  of  the  validation  of  an  objective! 

test. 

Christensen,  A.  M. , 

"A  Suggestion  as  to  Correcting  Guessing  in  Examinations," 
in  Journal  of  Educational  Research,  Vol.  14,  pp. 370-374, 

Dec.  1926. 

"Christensen  suggests  double  testing  as  a means  of  cor- 
recting for  guessing  in  examinations.  He  would  follow  a 
true-false  test,  after  a f ew  days,  with  a multiple-choice 
test.  His  final  score  would  be  the  summation1 of  the  items 
which  were  correct  on  both  tests." 

Christensen,  Arnold  M. , 

A Test  Record  Sheet,  J.  of  Ed.  Method  Vol.  V,  No.  8,  April 
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1926.  pp.354. 

There  are  three  types  of  examinations,  namely:  1. 

the  traditional  ’’essay-type"  of  written  Examination,  2. 
the  standardized  educational  test  or  scale,  and  3.  the 
newer  objective  examination. 

Clapp -Young, 

The  Clapp-Young  Self -Marking  Tests  Answer  Booklet.  Houghton 
Mifflin  Company,  Boston.  1929. 

"A  Test  device  has  recently  been  prepared  which  very 
much  simplifies  the  whole  problem  of  scoring  and  makes  the 
construction  and  use  of  a key  unnecessary.  It  is  known  as 
the  Clap-Young  Self-Marking  Device.  When  using  the  device, 
a student  indicates  his  answer  by  making  an  X in  one  of  a 
number  of  printed  squares.  By  an  ingenious  arrangement  of 
these  squares  and  carbon  strips,  the  marks  are  reproduced 
on  the  two  inner  pages  of  a sealed  folder.  Each  reproduced 
mark  falls  within  a square  if  the  answer  is  correct:  outside 
if  it  is  wrong.  When  the  folder  is  opened,  the  score  is 
obtained  by  simply  counting  the  squares  that  have  X’s  in 
them.  The  students  can  total  their  own  scores  within  a mirjj- 
ute  or  two  after  completing  the  test.  The  device  is  obtain- 
able in  the  formof  an  Answer  Booklet." 

Clark,  Wilfred  Whitehead, 

The  Use  of  New  Type  or  Objective  Tests  in  Physics.  1933. 

This  Thesis  contains  a valuable  list  of  references 
regarding  the  subject, 
l Clem,  0.  M. , 

Detailed  Factors  in  Latin  Prognosis.  Teachers  College, 
Columbia  University,  Contributions  to  Education,  No.  144, 
pp.  52.  1924. 

Clement,  J.  A., 

Use  of  Mental  Tests  as  a Supplementary  Method  for  Making 
School  Adjustments  in  Colleges.  Ed.  Adm.  & Super.  Vol.  6, 
No.  8.  Nov.  1920. 

There  seems  to  be  little  doubt  no w but  that  there  is 
practically  an  unworked  field  for  the  use  of  ments.l  tests 
in  the  grouping  and  classification  of  pupils  inthe  schools. 

Clements,  Samuel  Langhorne,  1835-1910 

English  as  she  is  taught,  by  Mark  Twain  (Pseud.)  with  bi- 
ographical sketch  of  author  by  Matthew  Irving  Lans,  Boston 
Mass.  Mutual  Book  Company.  1900. 

Cleveland  Survey  Tests  in  Arithmetic, 

Forms  land  2,  Public  School 
Illinois. 

Clifford,  Woody  & Sangren, 

Administration  of  the 
Yonkers -on-Hudson,  N. 

Cline,  E.  E., 

Learning  EDUCATION  Vol.  45,  No.  4,  pp.197.  Dec. 
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"Testing 

(a)  To 

(b)  to 
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see 
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what 

what 


has  been  learned, 
has  not  been  learned. 
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(c)  To  see  how  learning  (studying)  has  been  done. 

Cobb,  Stanwood, 

The  New  Leaven,  The  John  Day  Col,  N.  Y.,  pp. 204-207.  1928 

"The  futility  of  requiring  the  superior  type  of  stud- 
ent to  sit  through  the  boredom  of  a recitation  is  evident. 

In  many  public  school  systems  methods  are  now  being  sought  j 
for  freeing  the  gifted  child  from  the  worse-than-useless 
compulsion  of  the  recitation." 

Cocks,  A.  W., 

The  Pedagogical  Value  of  the  True-False  Examination. 
Baltimore.  1928 

College  entrance  examination  board. 

College  board  and  regents;  questions  and  answers  in  English 
l62p.s.  N.  Y.  College  entrance  pub.  co.,  1922 
College  Entrance  Examination  Board, 

Report  of  the  Commission  of  New  Type  Examinations,  April, 
1924. 

A very  significant  paper  in  the  light  of  the  history 
of  the  type  of  examinations  set  by  the  College  Entrance 
Examination  Board. 

Colvin,  S.  S., 

"Marks  and  the  Marking  System  as  an  Incentive  to  Study." 
Education,  No.  32,  pages  560-572;  May,  1912. 

A theoretical  discussion  of  the  inaccuracy  of  school  l| 
marks  and  the  urgent  need  of  making  them  accurate  in  order 
that  their  uses  as  an  incentive  to  study  may  be  permitted 
full  scope.  Advocates  the  development  and  use  of  objective 
tests  of  school  achievement  in  order  to  accomplish  this  aim^ 
Conference  on  examinations,  Eastbourne,  England,  1931. 

Conference  on  examinations,  under  the  auspices  of  the  Car- 
negie foundation  and  the  International  Institute  of  Teacher^ 
College,  Columbia  University,  May  23,  24,  25,  1931. 

Cooley,  A.  M.,  and  Reeves,  G., 

"Some  Investigations  Concerning  the  Use  of  Certain  Home-Eco- 
nomics Information  Tests",  Teachers  College  Record,  Vol.  24, 
No.  4,  pp.  374-392. 

Illustrates  the  use  of  the  multiple-choice  or  recogni- , 
tion  type  of  question  in  preparing  extensive  and  comprehen-  ; 
sive  information  examinations  in  the  field  of  home  economics. 
Cooprider,  J.  L. , 

"Exercises  in  Biology,"  School  Science  and  Mathematics,  Vol. 
25,  pp.  807-813,  1925. 

Corning,  G.  B,, 

"The  Meaning  of  Students*  Marks,"  School  Review,  Vol.  24, 
pp.  196-202,  1916. 

Corning,  H.  M., 

After  Testing,  What?  Chicago,  Scott,  Foresman  and  Company, 
1926,  page  213. 

Cottrell,  Donald  Peery, 

THE  MEASUREMENT  OF  CONFLICTING  VIEWPOINTS  IN  HIGHER  EDUCA-  | 
TION,  Teachers  College  Record,  pp.  635-651,  Ma.y,  1933. 
Courtis,  S.  A., 

"The  Relation  between  Rate  and  Quality  in  Educational  Mea- 
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surements.",  Journal  of  Educational  Research,  10:110-31, 
September,  1924. 

Crawford,  C.  C.,  and  D.  A.  Rinaldo, 

’’Some  Experimental  Comparisons  of  True-False  Tests  and  Tran 
ditional  Examinationa" , in  School  Review,  Vol.  33,  pp.  698- 
706,  November,  1925. 

"•...Real  differences  among  students  are  better  shown  by  the 
essay  examination.  This  has  been  clearly  indicated  in  a 
study  by  Crawford  and  Raynoldo.  They  selected  the  '’Much 
knowledge"  and  the"little-knowledge''  students  in  a group, 
according  to  their  grade  standings. . . . The  results  of  the 
experiment  showed  that  real  differences  among  students  are  . 
measured  more  emphatically  by  true-false  tests  than  by  essay 
tests. " 

Crofts,  James  Murray, 

Secondary  school  examination  statistics;  prefaced  by  a sim- 
ple introduction  to  statistical  methods,  by  J.  M.  Crofts... 
and  D.  Caradog  Jones... with  folding  plate  and  diagrams. 
London,  New  York  (etc.)  Longramns,  G-reen  and  Co. , ltd.  ,1928. 
Crofts  and  Jones 

"Secondary  School  Examination  Statistics,"  Longmans,  G-reen  j 
and  Co.,  Ltd.,  39  Paternoster  Row,  London,  E.  C.  4,  New 
York,  Toronto,  Calcutta,  Bombay  and  Madras. 

A helpful  little  book  regarding  Statistics. 

Cubbenley,  Ellwood  P., 

Public  Education  inthe  United  States,  Houghton  Mifflin  Co.,: 
Boston,  1919. 

Cubberley,  E.  P., 

The  History  of  Education,  chapter  IX,  Boston,  1920. 

Curzon,  (Lord  Curzon  of  Kedleston), 

Principles  and  Methods  of  University  Reform,  (1909). 
Dadourian,  H.  M. , 

"Are  Examinations  "forth  the  Price?"  School  and  Society, 

Vol.  21,  pp. 442-443.  1925. 

Dalman,  M.  A., 

"Hurdles,  A Series  of  Calibrated  Objective  Tests  in  First-  j 
Year  Algebra."  Journal  of  Educational  Research,  Vol.  1, 

No. 1,  pp. 47-62.  1920. 

Describes  a series  of  objective  tests  in  algebra,  with: 
certain  statistical  evidence  showing  their  usefulness. 
Dalman,  M.  A., 

"Hurdles,  a Series  of  Calibrated  Objective  Tests  in  First 
Year  Algebra." 

Darsie,  Marvin  L. 

"A  Method  of  Determining  Composite  Educational  Scores." 
Journal  of  Educational  Research  14:270-4.  November,  1926. 

Davis 

Teaching  the  Elementary  Curriculum.  The  Macmillan  Co. 
pp.426.  1931. 

Test 

Pretest,  teach,  test,  diagnose  results,  adapt  proced- 
ure, retest  and  test  again  to  the  point  of  mastery. 
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Davis,  William  Stearns, 

k DAY  IN  OLD  ROME,  Allyn  and  Cacon,  Boston*  1925. 

Davis # Henry  McVey,  1896. 

The  use  of  state  high  school  examinations  as  an  instrument 
for  judging  the  work  of  teachers,  by  H.  McVey  Davis. .N.Y.C . 
Teachers  College,  Columbia  University.  1934. 

Demogeot,  J.,  and  H.  Montucci. 

De  1 1 enseignement  superieur  en  Angleterre  et  en  Edosse  (1870) 
Denifle,  H., 

Die  Universit&ten  des  Mittelalters  bis  1400  (Berlin,  1885) 
Department  of  Superintendence, 

Third  Yearbook,  National  Education  Association,  Chapter  3, 
Arithmetic,  1925* 

Department  of  Superintendence, 

Fourth  Yearbook,  National  Education  Association,  Chapter  8, 
Arithmetic,  1926. 

Dewey,  John, 

The  School  and  Society,  University  of  Chicago  Press,  Chicag|j), 
111.,  Chapter  3,  1900. 

Dickinson,  Z.  C., 

"Suggestions  toward  Improving  Examination  Marks."  Report 
of  the  Committee  on  Educational  Guidance,  Bulletin  of  the 
University  of  Minnesota,  Vol.  26,  No.  31,  pp.  31-3 6,  August 
4,  1923. 

A discussion  of  the  usefulness  of  new-type  examination 
as  a partial  basis  for  grading  college  students. 

Dickson,  Virgil, 

"What  Effective  G-uidance  Techniques  are  Being  Administered 
through  Tests  and  Measuring  Devices."  Vocational  Guidance 
Magazine,  Vol.  VI,  No.  5,  February,  1928. 

Douglass,  H.  R. , 

Some  Uses  and  Limitations  of  the  Standard  Educational  Test. 
Ed.  Adm.  and  Super.,  Vol.  5,  No.  10,  Dec.  1919. 

The  need  of  Standard  objective  test. 

The  field  and  possibilities  of  educational  tests. 

The  limitations  of  educational  tests  as  they  now  exist 

1.  It  tests  the  progress  of  pupils. 

2.  As  well  as  testing  the  progress  made  by  the 
pupil. 

3.  It  tests  the  instructor. 

4.  By  the  progress  of  the  pupils  as  determined  b^ 
the  test,  the  course  of  study  must  be  tested. 

5.  In  like  manner  the  tests  are  being  used  to 
measure  the  efficiency  of  supervision. 

6.  Likewise  the  test  tests  methods  of  instruction. 

7.  The  test  is  a measure  of  the  textbooks. 

Douglas 

Modern  Methods  in  H.  S.  Teaching,  1926.  "Quizzes,  Examina- 
tions, and  Marking". 

Diagnostic  Testing  - to  determine  cause  of  weakness  in 
certain  subjects  as  shown  by  pupils. 

Douglas,  H.  R. , 

Modem  Methods  in  High  School  Teaching,  p.  369. 
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"Douglas  found  that  the  same  teachers  vary  in  the  marks 
they  themselves  assign  to  examination  papers  after  an  in- 
terval of  time." 

Doyle.  L.  and  Foote  M. , 

"T  he  Pledge  as  an  Instrument  to  Secure  Honesty,  in  Examin- 
ations," Peabody  Journal  of  Education,  Vol. 3,  pp.  79-84, 
1925. 

The  results  gathered  in  one  school  indicate  the  undes- 
irability of  requiring  the  pledge  of  honesty. 

Draper  and  Roberts, 

Principles  of  Am.  Secondary  Century  Company.  1932 

The  testing  lesson  takes  several  forms:  informal  test 
oral  quiz,  set  examination. 

DuBreuil,  A.  J., 

"True-False  Tests  in  Literature  and  Formal  English,"  Bulle- 
tin of  the  Illinois  Association  of  Teachers  of  English,  Vol. 
15,  pp.  1-17.  1923. 

DuBreuil,  A.  J., 

"An  Answer  to  Professor  Leonard’s  Dangers  of  the  True-False 
Test  in  English,"  Bulletin  of  the  Illinois  Association  of 
Teachers  of  English.  Vol.  16,  No.  7,  PP*  1-5.  1924. 

Earhart,  Lida  Belle,  1864, 

Types  of  teaching . .with  an  introduction  by  Henry  Sizzallo 
Boston,  New  York,  etc.  Houghton  Mifflin  Co.  1915. 


Eaton.  M.  P., 

"New  Style  Examinations  in  English  at  Uadleigh  High  School, 
New  York  Bulletin  of  High  Points,  Vol.  5,  No.  4,  pp.  3-16. 
1923. 

Edgerton,  A.  H.,  and  Cunliffe,  R.  B., 

"A  Public  School  Program  for  Collecting  and  Using  Occupa- 
tional Information."  "Tv/ enty -third  Year  Book  of  the  National 
Society  for  the  Study  of  Education. 

Edgerton,  A.  H., 

"Guidance  in  Detroit."  Twenty-third  Year  Book  of  the 
National  Society  for  the  Study  of  Education. 

Edgeworth,  F.  Y. , 

"The  Statistics  of  Examinations,"  and  "The  element  of  Chanc£ 
in  Competitive  Examinations,"  Journal  of  the  Statistical 
Society,  1888  and  1890  respectively. 

Educational  tests  and  their  uses. 

Review  of  educational  research,  vol.  iii,  No.l,  February 
1933. 


Elementary  School  Journal, Vol.  30 

New-type  tests,  pp.228.  Nov.  1929. 

The  new-type  test  will  be  retained  for  the  objective 
measurement  of  content;  and  the  standardized  test,  for  com- 
parative and  diagnostic  purposes. 

The  essay  examination  will  be  retained  for  the  light 
it  throws  on  problem-solving  ability  and  the  ability  to  or- 
ganize and  express  ideas. 

Eliot,  Charles, 

University  Administration,  Harvard  University  press.  Cambric 
Mass.  Pp. 52-53,  182-190,  296-208.  1908. 
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A good  sized  book  but  so  informative  and  written  so 
well  that  it  is  easy  reading  and  most  profitable. 

Ellis,  R.  E., 

Standardizing  Teachers'  Examinations  and  the  Distribution 
of  Class  Marks.  Bloomington,  Illinois,  The  Public  School 
Publishing  Co.  1927. 

A small  volume  largely  devoted  to  the  normal  curve 
idea  in  marking.  The  approach  is  logical  rather  , than  ex- 
perimental . 

Ellis.  R.  S., 

r'A  Method  of  Constructing  and  Scoring  Tests  G-iven  with  Time 
Limits  to  Eliminate  or  Weight  the  Effect  of  Speed."  School 
and  Society,  Vol . 28,  pp.  205-207.  1928. 

Elston,  B., 

"improving  the  Teaching  of  History  Through  the  Use  of  Testsf' 
Historical  Outlook,  Vol.  14,  pp.  300-305.  1923. 

Elwell,  Fayette  H.,  and  Fowlkers,  John  Guy, 

Instructional  Tests  in  Bookkeeping  (WorB.  Book  CcT. , 1934), 
pp.91 . 

The  authors  present  a series  of  eighty  tests  to  be  em- 
ployed in  the  teaching  of  bookkeeping  at  the  high  school 
and  college  levels. 

Encyclopaedia  Britannica, 

14th  edition,  vol.  8,  pp. 935-4-3. 

Encyclopedia,  The  Catholic  Vol.  5 

The  Universal  Knowledge  Foundation,  Inc.  New  York  1913. 
Encyclopaedia,  The  New  International, 

Second  Edition  Vol.  XXII,  Pub.  by  Dodd,  Mead  and  Co.,  N.Y.C* 
1923.  Pp  30,  4l4. 

Evans.  M.  E., 

"Objective  Tests  in  Eighth-Grade  Literature,"  Elementary 
English  Rpview,  Vol.  5,  pp.  13-22.  1928. 

Eve,  H.  W., 

Lecture  "On  Marking",  in  the  Practice  of  Education  (Cambrid$ 
1883) 

Farwell,  H.  W., 

"The  New-Type  Examination  in  Physics,"  School  and  Society, 
Vol.  19,  pp.  315-322.  1924. 

Fawsitt,  Charles  S., 

The  EDucation  of  the  Examiner  (Royal  Philosophical  Society 
of  Glasgow)  (Glasgow,  1905). 

Fenton,  Norman, 

Mental  Test  Scores  and  Self  Regard.  Ed.  Acm.  & Super., Vol. 
10,  No.  2,  Feb.  1924. 

An  interesting  and  Significant  aspect  of  the  introduc- 
tion of  mental  tests  into  institutions  of  higher  learning 
is  the  effect  upon  students  of  the  knowledge  of  their  own 
scores.  The  intelligence  test  from  data  taken  may  well  deal 
a severe  blow  in  the  sblar  plexus  of  the  ego.  The  problem 
as  a matter  of  intensity  of  human  experience  would  still 
warrant  consideration  if  only  one  student  were  affected. 
Benton,  N.,  and  Y/orchester,  D.  A., 

An  Introduction  to  Educational  Measurement,  Chapter  IV, 
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Boston,  1928. 

Fenton,  N.,  and  H.  C.  Lehman, 

"The  True-False  Question  and  the  Student's  Sense  of  Honesty 
School  and  Society,  Vol.  28,  pp.  115-116,  1928. 

Presents  a plan  for  allowing  students  to  qualify  an- 
swere  on  true-false  tests. 

Filer,  H.  A.,  and  L.  J.  O'Rourke, 

Annual  Reports  of  the  Chief  Examiner  and  the  Director  of  Reij- 
search  of  the  United  States  Civil  Service  Commission  for  the 
Fiscal  Year  Ended  June  30,  1923.,  pp.  1-64,  Government  prin- 
ting Office,  Washington,  D.  C.,  1923. 

A detailed  description,  accompanied  by  statistical  an-i 
alysis,  of  the  extensive  new-type  examination  experiments 
being  conducted  by  the  United  States  Civil  Service  Commissit 
See  other  annual  reports  of  the  Chief  Examiner  since  1919 
for  further  information  on  this  work. 

Fiske,  T.  S«, 

Annual  Reports  of  the  Secretary  of  the  College  Entrance  Ex- 
amination Board,  431  West  117th  St.,  New  York;  1921,  1922, 
1923,  and  1924. 

Brief  reports  of  the  various  developments  leading  the 
C.  E.  E.  B.  to  adopt,  in  part,  new-type  examination  technique 
in  certain  subjects  are  contained  in  these  annual  reports. 
Fish,  Louis  J. 

Examinations  Seventy-Five  Years  Ago  and  Today,  World  Book 
Company,  Yonkers -on -Hudson,  N.  Y. , pp.  25-30,  1930. 

Examinations  seventy -five  years  ago  and  today : com pari spn 
and  results  of  entrance  examinations  to  high  school.  29  p. 
tabs.  D. 

Fitch,  J.  G., 

"The  Proposed  Admission  of  Girls  to  the  University  Local 
Examination,"  Education  Miscellanies  (1865),  Vol.  X. 

Flemming,  Cecile  White, 

A Detailed  Analysis  of  Achievement  in  the  High  School.  Tea- 
chers College,  Columbia  University,  Contributions  to  Educa- 
tion, No.  196,  1926,  pp. 229. 

FI inn,  Vee, 

TEACHER  RATING  BY  PUPILS,  Educational  Method,  No.  5,  Vol.  X] 
pp.  290-295,  Feb.,  1932. 

Franzen,  R. , 

"Attempts  at  Test  Validation,"  Journal  of  Educational  Re- 
search, 6:145-58,  September,  1922, 

Freeman,  Frank  N. 

Mental  Tests,  Houghton  Mifflin  Co.,  1926,  503  pp. 

Fretwell,  E.  K., 

A Study  in  Educational  Prognosis,  Teachers  College,  Columbia 
University,  Contributions  to  Education,  No.  99,  1919,  55pp. 
Fritz.  M.  F., 

"Guessing  in  a True-False  Test."  Journal  of  Educational 
Psychology,  Vol.  18,  pp.  558-561,  1927. 

The  author  found  that  difficult  true -false  items  on  med- 
ical terms,  unknown  to  the  students,  were  answered  true  and 
false  in  the  ratio  6 2:38.  The  same  ratio  held  for  familiar 
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materials  • 

G-arrett,  Henry  E., 

Statistics  in  Psychology  and  Education,  Longmans,  Green  and 
Company,  pp.  377,  1926. 

Garnett,  W., 

MThe  Representation  of  certain  Examination  Results,”  Journa). 
Statist.  Soc.  (Jan.  1910). 

I., 

The  True-False  Test  as  a Measure  of  Achievement  in  College 


Gates,  A. 

ri 


Courses.”  Journal  of  Educational  Psychology,  Vol.  12,pp.276- 
287,  1921. 

Presents  much  correlational  data  obtained  from  ten 
classes  in  educational  psychology,  Columbia  University,  con 
cerning  the  true-false  examination  in  relation  to  essay  ex- 
aminations, concluding  that  the  evidence  more  than  justifies 
its  use  in  examination  procedures. 

Gates,  A.  I., 

"The  Correlations  of  Achievement  in  School  Subjects  with  In 
telligence  Tests  and  Other  Variables.”  Journal  of  Education- 
al Psychology,  13 : 129-39 ; 223-35 ; 277-85,  March,  April,  May, 1^22. 
Gates.  A.  I.,  and  R. Strang, 

"A  Test  in  Health  Knowledge,”  Teachers  College  Record,  Vol. 

26,  pp.  867-880,  1925. 

Gates,  Arthur, 

”A  Series  of  Tests  for  the  Measurement  and  Diagnosis  of  Read- 
ing Ability  in  grades  Three  to  Eight.”  Teachers  College 
Record,  1926. 

Gathany,  J.  M., 

"The  Giving  of  History  Examinations,”  Education,  Vol. 34-,  pp 
514-521,  1914. 

Gerry.  H.  L. , 

"Typej?  of  Tests  Desirable  for  Chemistry  and  the  Present  Sta|{- 
tus  of  Their  Development,”  School  Science  and  Mathematics, 

Vol.  25,  pp.  918-922,  1925. 

Gibbons,  Alice  Newman, 

Tests  in  the  social  studies,  Athens  Press,  Iowa  City,  la. 19£9. 

"A  record  of  testing  experience  in  senior  high  school 
social  studies." 

Giles,  F.  M., 

A Scholarship  Honor  System  in  HighSchools,  Ed.  Admin,  and 
Supervision,  Vol. 2,  No.  1,  Jan.  1916. 

It  is  quite  evident  that  too  many  of  our  students  are 
satisfied  with  low  standards  and  that  to  affect  this  the 
school  ought  to  put  a premium  on  good  scholarship. 

Giles,  J.  T., 

A Recitation  Score  Card  and  Standards,  El.  S.  J. , Sept .1922, 
page  31, 

The  aim  in  testing  is  to  determine  as  quickly  and  as 
accurately  as  possible  the  extent  of  knowledge  or  skill  pos- 
sessed by  each  pupil  in  regard  to  the  subject-matter  of  the 
lesson.  The  methods  and  tools  for  doing  this  have  been  im- 
proved so  greatly  in  the  last  few  years  that  no  teacher  can 
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be  excused  on  a plea  of  ignorance  of  their  use. 

Giles.  J.  T., 

’’improving  the  Objective  Test  Question,”  School  Review,  Vo]. 

35,  pp.  286-288,  1927. 

Advocates  elimination  of  poorest  response  rather  than 
selection  of  the  best  in  multiple-choice  tests. 

Gilliland,  A.  R. , and  Jordan,  R.  H., 

Educational  Measurements  and  the  Classroom  Teacher,  New  YoiKk, 
The  Century  Company,  265pp.,  1924. 

One  of  the  first  treatments  to  bring  the  subject  up  to 
date  at  the  time  of  publication. 

Glenn,  E.  R., 

”The  Conventional  Examination  in  Chemistry  and  Physics  vs. 
the  New-Type  Tests,”  School  Science  and  Mathematics,  Vol. 23 
pp.  671-675  and  646-656,  1921;  and  Vol.23,  pp. 459-470,  1923 
Good,  H.  G., 

"A  Form  of  Matching  Test,”  Ohio  State  University,  Education 
al  Research  Bulletin,  Vo.  6,  No.  8,  pp.  158-160,  1927. 

A variate  of  the  matching  test  in  which  pairs  of  items 
when  properly  matched,  stand  in  relation  of  subject  and  pre 
dicate  of  a sentence. 

Goodale,  M., 

”New-Type  Tests,”  Journal  of  Geography,  Vol.  27,  pp.63-70,1928, 
Gordon,  H.  C., 

’’Some  New-Type  Forms  in  High-School  Physics,”  School  Science 
and  Mathematics,  Vol.  27,  pp.  721-733,  1927. 

Graham,  Balfour, 

The  Educational  Systems  of  Great  Britain  and  Ireland  (2nd  e|d. 
Oxford,  1903) 

Gray,  William  S., 

Tests  in  Improving  Instruction.  El.S.  J.,Vol.  19,  1918. 

The  fundamental  purpose  of  all  testing  and  classroom  inves- 
tigation is  the  improvement  of  instruction. 

The  intelligent  use  of  tests  supplies  information  con- 
cerning all  phases  of  instruction  from  the  broader  issues 
involved  in  the  course  of  study  to  the  detailed  difficulties 
encountered  by  individual  pupils. 

Gray,  William  S., 

’’Value  of  Informal  Tests  of  Reading  Accomplishment.”  Journa 
of  Educational  Research,  Vol.  1,  No.  2,  pp.  103-11,  1920. 

Stresses  the  importance  of  informal  tests  prepared  by 
the  teachers,  holding  that  the  existence  of  standardized  ob 
jective  reading  scales  does  not  make  the  informal  test  un- 
necessary . 

Gray,  William  S., 

TESTS  AND  MEASUREMENTS  IN  HIGHER  EDUCATION,  Vol.  Vlll,  The 
University  of  Chicago  Press,  1936. 

The  most  important  set  of  tests  given  in  Harvard  Colletee 
are  the  general  examinations  which  come  toward  the  end  of  tpe 
senior  year. 

An  attempt  to  sketch  some  needed  types  of  research  in 
the  field  of  tests  and  examinations. 
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Green.  Harry  Andrew,  1889 

"The  use  and  interpretation  of  high  school  tests"  by  H.  A. 
G-reen..  and  Albert  N.  Jorgensen.  Longman,  Green  and  Co., 


N.  Y. 

List  of  educational  tests  mentioned  in  the  volume, pp. 
586-595.  1936. 

Green,  H?rry  Andrew,  1889 

The  use  and  interpretation  of  elementary  school  tests. 
Longmans,  Green  and  Co.  N.  Y. 

List  of  educational  tests  mentioned  in  this  volume 
pp. 510-513.  1935. 

Green.  C.  E., 

’New  Type  Tests,"  Research  Monograph  No.  3 Public  Schools 
Denver,  Colo.,  1926. 

A short  but  excellent  collection  of  class  room  tests 
illustrating  rules  for  constructing  such  measures. 

Green,  Harry  A.,  and  Jorgensen,  A.  N., 

Use  and  Interpretation  of  Educational  Tests,  New  York, 
Longmans,  Green  and  Co*,  1929,  4ll  pp. 

A carefully  prepared  handbook  designed  for  the  use  of 
the  classroom  teacher.  \. 

Gregory,  C.  A., 

Fundamentals  of  Educational  Measurement,  New  York,  D. 

Appleton  and  Co.  1922  283  pp. 

Valuable  historical  discussions  and  a general  treat- 
ment of  the  idea  of  measurement. 

Griffin,  H.  D., 

"Safeguarding  the  Final  Examination,"  School  and  Society, 

Vol.  23,  pp. 343-344.  1926. 

The  author  recommends  presenting  the  test  pages  bound 
in  varying  orders  to  prevent  cheating. 

Gundlach,  R., 

"A  Method  for  the  Detection  of  Cheating  in  College  Examina- 
tions," School  and  Society,  Vol.  22,  pp. 215-216.  1925. 

It  is  recommended  that  different  sets  of  the  same 
questions  be  presented  with  the  order  of  items  varying. 
Haddock,  Nellie  P., 

"The  use  of  theStanford  Achievement  Test  to  Indicate  High 
School  Success."  School  and  Society  25:  114-16,  Jan  22,1927. 
Hahn,  H.  H. , 

"A  Criticism  of  Tests  Requiring  Alternative  Responses." 
Journal  of  Educational  Research,  Vol. 6,  pp.  236-240.  Oct. 
1922. 

Attacks  the  accuracy  of  true-false  tests  and  the  right 
minus-wrong  formula  for  scoring  them,  and  also  holds  that 
they  are  undesirable  from  various  pedagogical  points  of  view. 
Hall,  G.  Stanley, 

Adolescence  (London,  1905) 

Hamilton,  Sir, 

Discussions  on  Philosophy  (London  1853) 

Hammond,  E.  L. , 

"A  Study  of  the  Reliability  of  an  Objective  Examination  in 
Ninth-Grade  English,"  School  Review,  Vol.  35,  pp. 45-51 . 1927 . 
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Hance,  R.  T., 

"Mdntal  Ability  and  the  Examination,'1  School  and  Society, 

Vol . 20,  pp. 445-446.  1924. 

Hannig,  W.  A., 

"Relative  Worth  of  Short  Answer  and  Free  Answer  Material 
in  Elementary  Teacher  Tests,"  Public  Personnel  Studies, 

Vol.  4,  pp.  277-278.  1926. 

Hartley,  Mrs.  Helene  (Willey)  1893, 

Tests  of  the  interpretative  reading  of  poetry  for  teachers 
of  English.  Teachers  College  Columbia  University.  1930 
Hartog,  P.  H.  and  Mrs.  A.  H.  Langdon, 

The  writing  of  English  (1907) 

Hartog,  P.  J., 

"Universities,  Schools  and  Examinations"  in  the  University 
Review  (July  1905) 

Hatch,  R.  W., 

"How  Can  Examinations  in  History  Be  Improved? 11  Horace  Mann 
Studies  in  Education,  Columbia  University,  N.  Y.  City, 

Feb.  1922. 

-Hawkes,  H. , 

"Experimenting  with  the  New  Type  of  Examination  at  Columbia., 
School  and  Society,  Vol.  15,  pp.l4l-l42.  1922. 

Hayes.  Seth, 

"Cooperative  Chemistry  Tests."  Journal  of  Educational 
Research,  Vol.  4,  No.  2,  pp.  109-120.  1921. 

Describes  the  cooperative  development  and  use  of  eight 
hundred  objective  questions  based  on  McPherson  and  Henderson 
Textbook,  in  the  high  schools  of  Cleveland,  Ohio. 


t! 


Heck,  A.  0 . , 


Administration  of  Pupil  Personnel,  Chapter  Vll.  Boston  1929. 
Keffernan,  H., 

"Objective  Measurement  of  Progress  in  Country  Schools,"  M. 

A.  Thesis,  University  of  California.  1925. 

Hemstreet,  A.  E., 

"Justice  in  Testing,"  The  School  Magazine,  Vol.  8,  No.  5, 

pp.  220-221.  1926, 

H enmon , V . A . C . , 

ACHIEVEMENT  TEST  IN  THE  MODERN  FOREIC-N  LANGUAGES,  Publica- 
tions of  the  American  and  Canadian  Committees  on  Modern 
Languages,  Vol.V.  New  York:  The  Macmillan  Co.,  pp.  363.1929. 
H enmon,  V.  A.  C., 

"Some  Limitations  of  Educational  Tests."  Journal  of  Educa- 
tional Research  7:  185-98.  March,  1923. 

Herring,  J.  P., 

"Educative  Control  by  Means  of  a New-Type  Measurement," 
Journal  of  Educational  Method,  Vol.  4,  pp.  94-102.  1924. 

Hildreth,  Gertrude  Howell, 

A Bibliography  of  Mental  Tests  and  Rating  Scales, , New  York 
N.  Y.  The  Psychological  Corporation  1933. 

1.  Mental  tests  - Bibl. 

2.  Examination  - Bibl. 

3.  Character  Tests  - Bibl. 

4.  Bibliography  - Bibl. 
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Hildreth,  Gertrude, 

MENTAL  ABILITY  MEASURED  BY  VERBAL  AND  NON-VERBAL  TESTS. 
Teachers  College  Record,  pp. 134-144.  Nov.  1932. 

Hildreth,  Gertrude  H., 

. . .Psychology  service  for  school  problems,  Yonkers-on- 
Hudson,  N.  Y.  ’Tor Id  Book  Co.,  1930. 

Hildreth,  Gertrude  H. , 

Learning  the  threeR’s;  a modern  interpretation,  1st  ed. 
Minneapolis , Nashville,  Educational  Publishers,  Inc.  1936. 
Education,  Elementary. 

Education,  Curricula 
Education,  Psychology. 

Holley , C . E. , 

The  Teacher’s  Technique,  chapter  XIV.  New  York,  1924. 
Holzinger,  Karl  J., 

Statistical  Methods  for  Students  in  Ed.  Ginn  and  Co.  372  pp , 
1928. 

Hope,  James  H.,  State  Supt.  of  Ed.,  Columbia,  S.  C., 

"The  South  Carolina  Every-Pupil  Testing  Announcement  of  the 
First  Annual  Testing  Program,  May  4-8  1936.  Mimeographed 
pp.33. 

Hopkins,  L.  T., 

"The  Construction  and  Use  of  Objective  Examinations," 

Boulder  Colo.,  University  of  Colorado,  1926. 

A collection  of  examinations  made  by  one  hundred  and 
eighteen  teachers  in  a course  of  new-type  examinations  con- 
struction. 

Hughes,  W.  Hardin, 

"Relation  of  Intelligence  to  Trait  Characteristics."  Journal, 
of  Educational  Psychology,  Vol.  XVI 1,  1926. 

Hughes,  W.  Hardin, 

"Personality  Traits  and  the  College  Success  of  High  School 
Graduates."  California  Quarterly  of  Secondary  Education. 

Vol  1,  January  1926. 

Hughes,  Hardin, 

"A  Rating  Scale  for  Individual  Capacities  Attitudes,  and 
Interests."  Journal  of  Educational  Method,  Vol.  IV.  June 
1925. 

Hull,  C.  L., 

Aptitude  Testing.  Yonkers,  The  Yforld  Book  Co.  1928,  535  pp. 

This  book  is  one  of  the  few  scholarly  treatments  in 
the  literature  on  educational  measurement.  Although  the 
special  emphasis  is  on  the  measurement  of  aptitudes,  this 
volume  should  be  mastered  by  all  thorough  students  of  test- 
ing. 

Hull,  Clard  L. , 

"The  Correlation  Coefficient  and  Its  Prognostic  Signifi- 
cance." Journal  of  Educational  Research  15:327-38,  May 
1927. 

Hunter,  Fred  M. , 

Ear  Marks  of  an  Efficient  School  System.  Ed.  A^m.  & Super. 
Vol  3,  No.  7,  Sept.  1917. 

Measurement:  has  its  systematic  and  well  established 
methods  of  measuring  its  own  results. 


179 


at 


Inge,  William  Ralph, 

SOCIETY  IN  ROME  UNDER  THE  CAESARS  by  William  Ralph  Inge. 
Fellow  of  King's  College  Cambridge,  and  assistant  Master 
Eaton.  Pub.  by  Chas.  Scribner's  Sons  N.  Y.  1892 
Jackson,  Dunham, 

Letter  to  the  Editor  of  the  Harvard  Alumni  Bulletin  in 
April,  1922. 

Criticized  Wood's  reliability  technique  in  his  College, 
Entrance  ExaminationBoard  investigation,  pointing  out  that 


why  the  new -type  te  sit- 


correlations  of  halves  of  a test  should  be  low  if  the  var- 
ious questions  are  not  designed  to  measure  the  same  thing 
but  to  measure  different  aspects  of  the  candidate's  reac- 
tions to  the  instruction  that  he  has  received. 

James.  B.  D., 

"The  Modern  Test" 

James  gives  the  following  reasons 
is  better  than  the  old  form: 

"Wider  range  of  subject-matter. 

Pupils  better  convinced  of  fairness  oi 
Less  writing,  more  time  for  thinking. 

Cannot  camouflage  ignorance  by  pushing  a facile  pen- 
cil. 

Pupils  enjoy  it  more. 

Calls  for  evidence  of  pupil’s  equipment  as  in  later 
life. 

Saves  energy  of  teacher. 

Requires  regular  and  constant 
Freedom  from  anxiety  at  final 


rating. 


reviews 
rating  time. " 


James ^ H.  W. , 


Own  Objective 
pp.  240-243, 


Technique  in  the  Construction  of  a Teacher's 
Tests,"  Peabody  Journal  of  Education,  Vol.  4, 

1927. 

Jennison,  H.  M. , 

"improvement  in  Examination  Technique  for  Teachers  of  Botany, 
School  Science  and  Mathematics,  Vol.  27,  pp.  832-843  and 
944-951.  1927. 

Jensen,  Milton  B., 

An  evaluation  of  three  methods  of  presenting  true-false  ex- 
aminations: Visual,  oral  and  Visual  oral.  School  and 

Society,  pp.  32-675-78*  November  15,  1930. 

Johnson,  F.  W., 

The  Administration  and  Supervision  of  the  High  School, 

Chapter  XV.  Boston,  1925. 

Johnson,  F.  W. , 

"The  Marking  System,"  the  Administration  and  Supervision 
of  the  High  School,  Boston,  Sinn  and  Co.,  Chapter  15,  1925. 
Jordan,  A.  M. , 

"Correlations  of  Four  IntelligenceTests  with  G-rades." 

Journal  of  Educational  Psychology  13:  419-29,  October , 1922. 
Journal  of  Educational  Research 
March  1935 

"The  general  opinion  seems  to  be  that  the  influence  off 
measurement  upon  the  instruction  may  be  either  beneficial 
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or  harmful  depending  primarily  upon  the  nature  and  quality 
of  the  measuring  intruments  used, 

Judd,  Charles  Hubbard, 

Measuring  the  Work  of  the  Public  Schools.  The  survey 
Committee  of  the  Cleveland  Foundation,  Cleveland  Ohio. 
"Kansas  Scholarship  Contest, 

for  1923,"  Teaching,  Emporia,  Kansas,  Vol 
13-39,  1923  and  Vol.  7,  No.  67,  pp.  1-69, 
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Christensen,  E. 
Appreciation,  " 


0., 

Journal  of 
1926. 


Educational 


Test  questions 
7,  No.  65,  pp. 

1924. 

Karwoski,  T.  R.  and 
"A  Test  of  Art 

Psychology,  Vol.  17,  pp.  187-194, 

Kefauver,  Grayson  and  Harold  Hans, 

"Measurements  of  Outcomes  of  Guidance  in  Secondary  Schools." 
Teachers  College  Record,  Jan.  1935.  pp.  314-335. 

Kelley,  T.  L., 

"A  New  Method  for  Determining  the  Significance  of  Differences 
in  Intelligence  and  Achievement  Scores."  Journal  of  Educa-j 
tional  Psychology  14:321-33.  Sept.  1923. 

Kelley,  Truman  L. , 

Educational  Guidance.  Teachers  College.  Columbia  Universitjy, 
Contributions  to  Education,  No.  71,  1914  116  pp. 

Kelley,  T.  L. , 

The  objective  measurement  of  the  out-comes  of  the  social 
studies.  Historical  outlook,  pp.  21-  66-72.  February  1930. 
Kelley,  T.  L. , 

The  Interpretation  of  Educational  Measurements.  Yonkers, 

The  World  Book  Co.  1927.  363  pp. 

This  book  is  the  best  critical  presentation  of  the 
theory  and  practice  of  educational  test  construction.  Two 
especially  valuable  features  are:  (l)  the  evaluations  of 
hundreds  of  educational  tests,  thus  laying  a basis  for 
critical  selection;  and  (2)  the  development  of  the  stat- 
istical techniques  related  to  educational  measurement, 

Kelley,  Truman  Lee  & Krey,  A.  C., 

Tests  and  measurement  s in  the  social  sciences.  Scribner’s 
Sons,  N.  Y.  1934. 

Kelley,  T.  L. , and  Ruch,  G.  M., 

Stanford  Achievement  Test. 

Book  Company,  59pp.  1922. 

Kennon,  Laura, 

Tests  of  literary  vocabulary  for  teachers  of  English.  Also1) 
as  a Thesis,  Columbia  University  1923. 

Kepner,  T.  P. , 

"A  Survey  of  the  Test  Movement  in  History,"  Journal  of 
Educational  Research,  Vol.  7,  pp.  309-325,  1923. 

Keys,  Noel, 

The  improvement  of  measurement  through  cumulative  testing; 
an  empirical  study  of  two  hundred  elementary  school  children 
over  a period  of  four  years.  New  York  City,  Teachers  College 
Columbia  University.  1928. 

Kimball,  E.  P., 

"As  for  Examinations,"  School  and  Society,  Vol.  27,  pp.571- 
572.  1928. 


Manual  of  Directions,  World 


*1 


11 


Kimmel,  H., 

"Exemption  from  Examinations  and  Grades"  in  School  and 
Society,  Vol.  8,  pp. 112-14.  (July  27,  1918) 

Kimmel,  W.  C., 

"Practice  Tests  in  the  Social  Studies, " Historical  Outlook, 
Vol.  14,  pp.  354-358,  1923. 

Kimmel,  W.  G. , 

"Testing  Pupil  Progress  in  Community  Life  English, " Supple- 
mentary Educational  Monographs,  26,  pp.  33-69.  1925. 

Kinder,  J . S. , 

Should  the  High  Schools  Give  Examinations?  EDUCATION  Vol. 

47,  No.  10.  p.  595.  June  1927. 

..."examinations  are  not  primarily  for  testing  the 
pupils  knowledge,  but  as  an  urge  to  the  pupil  to  organize, 
systematize,  and  have  ready  that  knowledge." 
page  596. 

"Examinations  must  be  a means  to  an  end.  They  are  not 
the  end  of  the  knowledge  acquired,  but  an  aid  to  acquiring 
the  knowledge  and  making  it  coherent  and  usable." 

Kinder,  J.  S., 

"Supplementing  Our  Examinations,"  Education,  Vol.  45,  pp. 
557-566,  1925. 

King,  Irving  and  Newcomb,  Hollo  E. , 

Improvement  in  Handwriting,  Ed.  Admin.  & Super.  Vol.  2,  No. 
8,  Oct.  1916. 

Measuring  pupils  as  to  improvement  or  deterioration 
that  occurred  in  the  speed  and  in  the  quality  of  the  hand- 
writing of  pupils  during  school  year. 

Kingsh  y,  John  H., 

El.  Sch.  Journal  Vol.  24,  p.129.  Oct.  1920. 

Standardized  tests  make  possible  a study  of  methods 
through  the  accurate  measurement  of  accomplishment . Such 
measurement  is  true  in  its  findings;  eliminates  some  time 
honored,  time-wasting  classroom  practices;  and  appeals  to 
teachers  and  school  executives. 

Klise,  N.  M. , 

"Students'  Opinions  of  Types  of  Examinations";  in  School 
and  Society,  Vol.  24,  pp.  23-24.  (July  3,  1926) 

"Klise  found  that  in  a class  of  337  students  in  a 
course  in  elementary  psy.  265  or  79  per  cent  preferred  the 
new-type,  6l  or  18  per  cent  preferred  the  essay  examination, 
and  11  or  3 per  cent  were  undecided.  The  reasons,  in  the 
order  of  the  frequency  of  their  occurence,  which  the  265 
students  gave  for  their  preference  were : 

Student  has  check  on  his  own  knowledge. 

More  and  greater  variety  of  material. 

More  like  life  situations. 

No  premium  on  "wordiness . " 

Requires  thinking  and  judgment. 

Fairer  grade  obtained. 

Cannot  "cram." 

Cannot  "bluff." 

Does  not  rush  student  for  time 
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Less  strain  and  tension. 

Less  chance  to  misinterpret  questions* 

Mistakes  clear  to  students. 

Knight,  F.  B. , 

"Data  on  the  True-False  Test  as  a Device  for  College  Exam- 
ination." Journal  of  Ed.  Psy.  Vol.  13,  No.  2,  pages  75-30; 
February,  1922. 

with  the  true-false,  examination  in 
the  State  University  of  Iowa,  conclud- 
true-false  test  including  ingenious 
laboratory  technique  can  be  expected  !| 
better,  than  written  examinations, 


Reports  an  experiment 
physics  at 
thorough 
statements  concerning 
to  do  as  well,  if  not 


elementary 
that  "a  more 


with  the  sound  advantage  clearly  on  its  side  of  saving  the 
instructor’s  time." 

Knudsen,  Charles  W. , 

Evaluation  and  Improvement  Teaching.  Chapter  VIII,  "Evalua- 
tion of  Instruction  by  Means  of  Standardized 


Garden  City,  N.  Y:  Doubleday,  Doran  and  Co., 
Includes  a bibliography. 


1932. 


Tests, " 

Inc.,  pp.285- 


320. 

Kohs,  S.  C., 

"High  Test  Scores  Obtained  by  Subaverage  Minds."  Psycholog- 
ical Bulletin,  Vol.  17,  pp.  1-5;  1920. 

Attempts  to  formulate  the  mathematics  of  guessing  as 
it  pertains  to  the  two-alternative  or  true-false  type  of 
test,  assuming  that  responses  to  such  a test  are  completely 
naive  and  based  upon  mere  chance  alone.  Shows  that  under 
such  conditions  with  a fifty-item  test  the  chances  are  smalijL 
that  any  one  would  receive  a score  of  more  than  16  per  centjj 
correct.  (Chance  of  such  a score  is  1 out  of  17.) 

Kolstoe,  S.  0., 

"Reactions  to  True-False  Tests,"  School  of  Education  Record1 
University  of  North  Dakota,  11,  pp.  54-44,  1926. 

Krey,  A.  C., 

Different  functions  of  examinations,  by  A.  C.  Drey  and 
Palmer  Oliver  Johnson.  Minneapolis,  University  of  Minnesota* 
Bulletin  of  the  University  of  Minnesota,  v.3 6,  no. 4. 

Krey,  A.  C., 

What  does  the  New-type  examination  measure  in  history? 
Historical  outlook,  pp.  19-  159-62,  April  1928. 

Kyte,  George  C., 

Scientific  Tests  in  Education  and  their  Use,  ED.Acm.  Suoer.i 
Vol.  9,  No.  3,  March  1923. 

The  questions  raised  by  teachers:  how  can  we  deter- 

mine the  ability  intelligence,  educational  needs,  and  pro- 
gress of  the  children  in  our  clssses  , or  to  what  extent 
are  our  pupils  achieving  up  to  their  capacity  are  answered 
by  Binet,  Terman,  Goddard,  Yerkes,  and  others  in  the  form 
of  scales  for  measuring  the  intelligence  of  human  beings 
by  means  of  individual  examinations. 

Laird.  Donald  A., 

"A  Comparison  of  the  Essay  and  the  Objective  Type  of  Exam- 
inations." Journal  of  Educational  Psychology,  Vol.  14,  No. 

2,  pp.  123-124;  1923. 


183 


Shows  that  the  average  student  exhibits  twice  as  much  informa- 
tion about  a topic  when  given  an  objective  test  as  when 
given  an  essay  test  on  the  topic. 

Laird^  D.  A., 


'A  Note  on  the  Shortening  of 
Educational  Psychology,  Vol. 
Lang,  Albert  Ray, 

Modern  Methods  in  the  Written 


the 

15, 


Examination, 
pp.  116-117. 


Journal 

1924. 


of 


Examination.  Houghton  Mifflin 


Co. , Boston.  1930 


Lane-Poole,  Stanley, 

Mediaval  India  Under  Mohammedan  R ule,  Prof.  Stanley  Lane-  j; 
Poole,  Prof,  of  Arabic  at  Trinity  College,  Dublin.  Pub.  by  i 


G.P.  Putnam's  London:  1903. 


La them,  Henry,  1821-1902. 

On  the  action  of  examinations  considered  as  a means  of  sel- 
ection. Boston,  Mass.  W.  Small.  1886. 

Laycock,  S.  R. , 

"The  Laycock  Test  of  Biblical  Information  Journal  of  Educa- 
tional Psychology,  Vol.  16,  pp.  329-334.  1925. 

Lathrop,  H.  0., 


Lee 


"Testing  in 
Vol.  26,  pp, 
and  Symonds, 
New-type  or 


Commercial 

256-262. 

P.  M. , 

objective  tests: 


Geography , " 
1927. 


Journal  of  Geography, 


a summarv  of 


Journal  of  educational  psychology. 


recent  invOstiga- 
24:  21-28,  Jan. 


Lee 


Lee, 


tions . 

1933. 

and  Symonds, 

New-type  or  objective  tests:  a summary  of  recent  investiga- 

tions (October  1931 -October  1933).  Journal  of  educational 
psychology,  pp.  25-  161-84.  March  1934. 

B., 

"Some  Faults  Common  to  Informal  Objective  Tests  Made  by 
High-School  Teachers,"  Educational  Administration  and 
Supervision,  Vol.  14,  pp. 105-113.  1928 

A number  of  faults  were  found  and  listed.  Many  of 
these  are  obvious  and  most  have  been  previously  reported 


Lee 


OF  HIGH-SCHOOL  TEACHERS,  United  States 
Interior  Office  of  Education.  Bulletin, 


by  Weidemann  and  others.  These  precautiGns  are  nevertheless 
very  important, 
and  Segel, 

TESTING  PRACTICES 
Department  of  the 
No.  9.  1936. 

J.  Murray, 

A guide  to  measurement  in  secondary  education.  N ew  York 
Appleton-Century  Co.  1936. 

Lefever,  D.  Welty, 

Dangers  and  values  in  teacher-made  tests. 

409-12.  March  1933. 

L-either,  Russell  G.,  and  Porteus,  Stanley  D. , 

The  Leiter  International  Performance  Scale,  University  of 


Lee , 


Education,  53: 


Hawaii  Research  Publications,  No.  13,  ( Honolulu:  Univers- 
ity of  Hawaii,  1936).  Pp.  42. 

The  authors  present  a description  of  and  data 


relative 

-it- 


I 


184 


to  the  Leither  International  Performance  Scale.  One  of  its' 
most  distinctive  features  is  the  fact  that  neither  verbal 
instructions  nor  pantomime  are  necessary  in  applying  the 
tests.  It  has  been  standardized  for  different  cultural 
groups. 

Lincoln,  E.  A., 

"Beginnings  in  Ed.  Measurement. 

Lincoln,  Edward  Andrews. 

Testing  and  the  uses  of  test  results,  by  Edward  A.  Lincoln 
and  Linwood  1.  Workman.  1935. 

Lincoln,  Edward  A.  & Workman,  Linwood  L. , 

Testing  and  the  uses  of  test  results. 

1935. 

Lincoln  Library  of  Essential  Information, 

Pub.  by  the  Frontier  Press  Co.,  Buffalo,  N.  Y. 

1929. 

Facts  regarding  Socrates,  Quintillian  and  John  Anos 
Comenius. 

Lohr , V . C . , 

"A  Comparison  of  Some  Tests  G-iven  in  High  School  Physics, 
School  Science  and  Mathematics,  Vol.  27,  pp.  74-85.  1927 

Loofbourow,  Graham  Crain, 

Test  materials  for  problem  behavior  tendencies  in  junior 
high  school  boys.  University  of  California  press,  1932 
Berkeley,  California. 

Lowe,  M.  L. , and  Crawford,  C.  C., 

"First  Impression  versus  Second  Thought  in  True-False 
Tests,"  in  Journal  of  Ed.  Psychology,  vol.  20,  pp.  192-95 


Lippincott.  1925. 


Macmillan  Co.,  N.  Y. 

page  1628, 


!i 


March.  1929. 

"Lowe  and  Crawfcrrd  found  that  when  students  go  over 
the  statements  about  which  they  have  been  uncertain  and 
upon  second  thought  change  them,  the  chances  are  about  two 
to  one  that  the  change  will  be  correct." 

Lowell,  A.  L. , 

"The  Art  of  Examinations"  in  Atlantic  Monthly,  Vol.  137, 
pp.  62,  Jan.  1926. 

"The  value  of  the  procedure  function  of  examinations  ji 
has  been  well  stated  by  Pres.  Lowell  of  Harvard,  as  follows: 
the  art  of  passing  examinations  is  one  of  the  most  useful 
to  acquire.  . .Throughout  our  lives  we  are  constantly  forced; 
to  muster  all  we  can  of  our  previous  knowledge,  and  the 
habit  of  doing  so  can  be  cultivated  by  practice ...  the  con-,' 
elusion... is  that  examinations  properly  used  are  a vital 
part  of  the  educational  process,  but  that  the  art  of  using!' 
them  to  produce  the  best  results  is  highly  comolex  and 
difficult. " 

Lund,  John, 

"The  Newton  Experiment"  in  the  UNDERSTANDING  THE  CHILD. 

Pub.  by  the  Massachu setts  Society  of  Mental  Hygiene.  10 
Ferry  St.,  Concord  N.  H.,  April  1934. 

MacPhall , A.  H., 

"Measuring  Achievement  in  High  School,"  American  Educational 
Digest,  Vol.  46,  pp.  357-359  and  378.  1927. 


Madsen,  I.  N., 

"Group  Intelligence  Tests  and  Means  of  Prognosis  in  High 
School."  Journal  of  Educational  Research  3:43-52,  Jan. 

1921. 

Mahaffy,  J.  P., 

GREEK  LIFE  AND  THOUGHT.  Macmillan  and  Co.,  N.  Y.  1887 
Miller  J.  B., 

"Economic  and  Social  Correlatives  of  School  Progress  in 
New  York  City,"  Teachers  College  Record,  XXXIV,  pn.  655- 
700.  May,  1933. 

Maloney,  E.  and  Ruch  G.  M. , 

"The  Use  of  Objective  Tests  in  Teaching  as  ILLustrated  by 
Grammar,"  The  School  Review,  Vol.  37,  pp.  62-66,  1929. 
Manahan,  J.  L. , 

Grading  and  Promotion  of  High  School  Pupils.  Ed.  Admin.  & 
Super.  Vol.  1,  No. 9,  Nov,  1915. 

The  recent  movement  for  the  measurement  of  educational, 
products  has  awakened  a desire  on  the  part  of  students  of 
educational  problems  to  know  the  facts  concerning  the  ac- 
tual working  of  the  marking  systems  in  our  colleges  and 
secondary  schools. 

Marsh,  W.  R. , et  al, 

Report  of  the  Commission  on  new-types  of  Examinations,  etc. 
New  York,  The  College  Entrance  Examination  Board,  1923,  pp. 
39. 

Matthew,  Arnold, 

Higher  Schools  and  Universities  in  Germany  (1874). 

May , M , A . , 

"Measuring  Achievement  in  Elementary  Psychology  and  in  Other 
College  Subjects."  School  and  Society,  Vol.  17,  No.  435, 
pp.  472-476  (April  28,  1923);  Vol.  17,  No.  438,  pp.  556-560! 
(May  19,  1923). 

Presents  statistical  data  and  names  for  a standardized 
new-type  examination  covering  the  subject  matter  in  Wood-  j| 
worth's  Psychology. 

May,  M.  A., 

"Standardised  Examinations  in  Psychology  and  Logic,"  School 
and  Society,  Vol. 11,  pp.  533-540.  May  1,  1920. 

Gives  sample  objective  questions  of  different  types 
used  in  psychology  and  logic,  together  with  a statistical 
technique  for  treating  the  examination  scores. 

Mead,  A.  R. , 

"Suggestions  for  the  Training  of  Teachers  in  the  Use  of 
Educational  Measurements,"  Educational  Administration  and 
Supervision,  Vol.  12,  pp.  23-43,  1926. 
i Mead,  Cyrus  D. , 

The  Method  of  Experimentation.  The  Method  of  Progress.  Ed.;: 
Adm.  & Super.  Vol.  5,  No.  1.  Jan.  1919. 

Just  as  any  science  has  had  to  have  tools  with  which  ij 
to  experiment  educators  in  the  last  few  years  have  evolved  !; 
the  tools  for  commonest  media  is  known  as  the  "controlled 
test . " 
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of  Cooperative  He- 
ll. L.  Smith,  Direct-,' 


(The)  Measurement  of  Ability  in  Reading 

Preliminary  Scales  and  Tests  Teachers  College  Record.  Sent. 
1913. 

Measurements,  Educational, 

Fifteenth  Annual  Conference  on  Eureau 
search,  Indiana  University  Sch.  of  Ed 
or  Vol . IV,  No.  6.  July  1928. 

"in  order  to  be  instrumental  in  the  adjustment  of  in- 
dividuals and  educational  or  vocational  conditions,  we  need 
to  know  all  we  can  that  is  relevant,  about  both  elements, 
the  work  and  the  individual.  It  is  the  analysis  of  the  in-jl 
dividual  that  is  emphasized  in  this  paper... Me  have  no  means 
at  present  for  measuring  these  less  objective  traits  or 
abilities  with  the  use  of  a standardized  test,  and  the  bestj, 
available  method  is  not  as  reliable  as  we  would  desire, 
but  under  careful  direction  it  can  be  used,  as  found  in 
both  industry  and  education,  with  useful  results." 

Measurements -Standard  Tests  and  Their  Use. 

Teachers  College  Record.  Oct.  1924. 

Recommends  that  more  thought  be  given  to  tests,  their  j 
conclusions,  and  uses.  Need  of  revisions  in  test  elements. 

Advisability  of  informing  pupils  of  results  of  their  test. 

Melville,  Norbert  John  1884, 

Standard  method  of  testing  juvenile  mentality  by  the  Binet- 
Simon  scale  with  original  questions,  pictures,  and  drawings), 
a unifrom  procedure  and  analysis,  by  Norbert  J.  Melville... 


by  Wm. 
1917. 


Healy.  Philadelphia  and  London 


English  Literature," 
491-496,  1922. 


The  English 


with  an  introduction 
J.  B.  Lippincott  Co. 

Melvin,  A.  G. , 

"A  True-False  Test  in 
Journal,  Vol. 11,  pp. 

['Methods  of  College  Tchg." 

School  & Society  Vol.  28,  pp.  433,  Oct.  1928. 

Quiz  Method 
"Unannounced  Quizzes” 

"Unit  Quizzes" 

"Oral  Quizzes" 

Special  Reports. 

Meumann,  E., 

VORLESUNG-EN  ZUR  EINFUHRUNG  IN  DIE  EXPERIMENTED  PADAGC 

Vol  II  (Leiozig,  1913) 

Miller,  G.  F . , 

"A  Variation  in  the  'True  and  False'  Achievement  Test." 
School  and  Society, Vol.  20,  No.  504,  p.  250,  Aug.  23,  1924* 
Describes  the  true-false  test  in  educational  psycho- 
in which  the  student  is  to  assign  the  numbers  1 to  those 
statements  which  are  true,  2 to  those  which  are  false,  and 
3 to  those  which  may  be  either  true  or  false. 

Miller,  (George  Frederick, 

Objective  tests  in  high  school  subjects.  Norman,  011a., 

G.  F.  Miller,  1926. 

A very  good  collection  of  objective  tests. 

Miller,  77. S., 


GIK, 


logy 
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"An  Objective  Test  in  Educational  Psychology".  Journal  of 
Educational  Psychology,  Vol.  16,  No.  4-,  April,  1925. 

Presents  statistical  evidence  of  the  reliability  and 
validity  of  a new-type  examination  in  educational  psycho-  j| 
logy  which  was  used  for  ten  successive  quarters  without  sig- 
nificant change  either  in  the  measures  of  central  tendency 
or  of  variability. 

Mills,  Frederick  C., 

Statistical  Methods  Applied  to  Economics  and  Business. 

Henry  Holt  and  Company,  pp.  604,  1924. 

Minnesota,  University  Comm,  on  Educ.  Research  College  Examina- 
tions 6l  p.,o. 

Minneapolis,  Author,  (Bulletin  of  the  University  of  linn., 
Vol.  35,  No.  22,  1932. 

Monroe,  Paul, 

Cyclopaedia  of  Education,  Vol.  2,  pp.  532-538. 

Monroe,  Paul, 

The  Folkestone  Conference  on  Examinations,  Edited  by  Paul 
Monroe,  Pub.  in  1931,  Teachers  College,  Columbia  Universitjy. 
The  significance  of  this  report  may  be  judged  by  the  closing 
remark  in  the  review  of  the  last  volume,  published  in  the 
London  Times  of  July  4,  1936. 

"This  investigation  and  the  published  reports  may  comje 
to  be  regarded  as  the  herald  of  a great  reform  in  our  Ed. 
System. " 

Monroe,  W.  S., 

Diagnostic  Tests  in  Arithmetic,  Public  School  Publishing 
Co.,  Bloomington,  Illinois. 

Monroe,  W.  S., 

The  Theory  of  Educational  Measurements,  Boston,  Houghton 
Mifflin  Company,  363  pp.,  1923. 

Monroe,  W.  S., 

"Theory  of  Educational  Measurements",  Houghton  Mifflin  Co., 
1925. 

Monroe,  W.  S., 

Written  Examinations  and  Their  Improvement.  Eulletin  No. 

9,  of  the  Bureau  of  Educational  Research,  University  of 
Illinois,  1922. 

It  is  now  out  of  print.  It  was  one  of  the  first  treat- 
ments of  the  relative  merits  of  traditional  and  objective 
examinations. 

Monroe,  W.  S., 

"Written  Examinations  versus  Standardized  Tests,"  School  Re- 
view, Vol.  32,  No.  4,  pp,  253-265,  April,  1924. 

A comparison  of  the  reliability  of  written  examinatiohs 
and  standardized  tests.  Believes  "that  teachers  can  make 
material  reductions  in  both  constant  and  variable  errors  in 
examination  grades  if  they  observe  certain  rules  in  the  pre- 
paration and  administration  of  written  examinations." 

Monroe,  W.  S.,  and  R.  E.  Carter, 

"The  Use  of  Different  Kinds  of  Thought  Questions  in  Secon- 
dary Schools  and  their  Relative  Difficulty  for  Students," 
Bureau  of  Educational  Research,  University  of  Illinois, 
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1923. 

Twenty  kinds  of  thought  questions  are  described. 

Monroe,  W.  S.,  DeVoss,  J.  C.,  and  Kelly,  F.  J., 

Educational  tests  and  measurements.  Rev.  ed.  Boston, 
Houghton  Mifflin  Co.  1924. 

Monroe,  W.  S.,  and  Souders,  L.  B., 

''Present  Status  of  Written  Examinations  and  Suggestions 
for  Their  Improvement."  Bulletin  No.  17  of  the  Bureau  of 
Educational  Research,  University  of  Illinois;  1923. 

Reports  of  details  of  an  extensive  investigation  of 
present-day  te  ndencies  in  giving  written  examinations  in 
high  schools , including  data  on  the  reliability  of  actual 
written  examinations  and  instructions  for  supplementing 
the  traditional  examinations  bv  the  adoption  of  the  new- 
type  examination  technique. 

Moore,  N.  E., 

"Analysis  of  Study  Questions  Found  in  Text  Books  far  the 
Intermediate  Grades.  Elementary  Sch.  Journal  27:194-208. 
Nov.  1926. 

Morley,  E.  E., 

"Final  Examinations  and  the  Effect  of  Exemptions," 


School  Teachers.  Vol.  2,  pp. 90-91.  1926. 


High 


Mort,  Paul  R. , Wright,  Wendell  W.,  Feather stone,  W.  B., 

"Fitting  the  School  to  the  Pupil,"  Report  of  the  Survey 
of  the  Schools  of  Chicago,  111.  Vol.  2 (5  Vols.)  PP.3-l4l.i 
1932. 

Morton,  R.  L. , 

"The  Examination  Method  of  Licensing  Teachers,"  in  Educa- 
tional Administration  and  Supervision,  Vol.  6, pp. 421-32. 
(September,  1920) 

It  tells  of  conducting  an  experiment  with  the  grading! 
of  examination  for  teachers'  certificates.  The  futility 
of  grading  essay  examination  papers  is  indicated. 

Moyer.  F.  E., 

"New  Types  of  History  Tests,"  Historical  Outlook,  Vol.  l4,i 
pp. 323-324.  1923 

Moyer.  F.  E.,  et  al, 

"Middle  States  Conference  on  Historv  Tests,"  The  Historica 
Outlook.  Vol.  14,  pp. 323-328.  1928^ 

The  advantages  and  economy  of  objective  tests  are 
discussed. 

Munroe,  James  Phinney, 

THE  EDUCATIONAL  IDEAL  (An  outline  of  its  growth  in  Modern  j 
times)  Pub.  by  D.  C.  Heath  and  Co.,  Boston,  U.S.A.  1896. 

Summary 

I "THE  PROCESS  OF  GROWTH  OF  THEEDUCATIONAL  IDEAL;  THE  MIDDLE1 

AGES;  TIP  RENAISSANCE;  THE  HUMANISTS:  ; THE  NATURAL- 
SCIENTISTS;  THE  EDUCATIONAL  DEMOCRATS;  THE  SENSATIONALISTS 
ETHICAL  EDUCATION;  THE  TRUE  DATA  OF  ED. 

Munster,  Hugo, 

PSYCHOLOGY  AND  MENTAL  EFFICIENCY  (New  York,  1913). 

McAfee,  L.  0., 

"The  Reliability  of  Non-Stan dardized  Point  Tests". 


I 
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Elementary  School  Journal,  Vol.  24,  No.  8,  pp.  579-585.  April 
1924; 

A comparisonof  three  forms  of  new-type  questions  and 
the  essay-type  question  given  tof if ty-seven  seventh -grade 
children  in  American  history.  Concludes  that  new-type 
question  tests  give  more  reliable  results  than  the  essay- 
question  test  and  that  one-word-answer  questions  are  slight!- 
ly  more  reliable  than  true-false  questions. 

McAndrew,  William, 

"Our  Old  Friend,  the  Examination";  in  Proceedings,  National 
Education  Association,  pp.  527-33.  1916. 

"...some  teachers,  seeing  no  use  in  examinations  as 
employed,  have  gone  so  far  as  to  advocate  their  abolishment 
from  the  educational  system.  Character istic  of  such  a point 
of  view  is  the  attitude  of  Supt.  McAndrew  when  he  summed  up; 
a discussion  of  examinations  by  saying  "Hence  from  all  the 
considerations  I conclude  that  the  use  of  outside  examina- 
tions to  determine  the  fitness  of  the  pupil  is  dishonest, 
unfair,  immoral  and  wicked.'" 

McCall,  W.  A., 

"A  New  Kind  of  School  Examination,"  Journal  of  Educational 
Research,  Vol.  1,  pp.  3^-46.  1929. 

McCall,  W.  A., 

"The  New  Kind  of  School  Examination."  Journal  of  Educational! 
Research,  Vol.  1 page  33;  1920. 

Describes  the  true-false  far  m of  question,  discusses 
methods  of  scoring,  gives  instructions  fcr  their  prepara- 
tion, and  claims  certain  advantages  for  this  form  of  exam-  jj 
ination  which  make  it  in  his  opinion  "A  herald  of  newer  andi 
better  types  of  examination."  Points  out  that  12,000,000 
examinations  are  given  in  the  schools  each  year;  hence  the  1! 
importance  of  examination  technique. 

McCall,  W.  A., 

in  Education."  Macmillan  Co.  Bob  ton, 
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Macmillan  Co.  N.  Y.  1922 
the  essentials  of  educa- 
discussion  of  the  new- 


II 


"How  to  Experiment 
Mass.  1925. 

An  excellent  treatment  of  practical  experimental  work 
in  education, 

W.  A., 

to  Measure  in  Education,  The 
This  book  attempts  to  present 
tional  measurements  and  includes  a 
type  content  examinations. 

McCall,  William  A.  & Bixler,  Harold  H. , 

How  to  Classify  Pupils  Teachers  College,  Columbia  University 
N.  Y.  page  84.  1928 

McCall,  and  Crabbs, 

STANDARD  Test  Lessons  in  Reading"  Teachers  College  Record 
1925. 

HcClusky  and  Dolch,  W., 

"A  Study  Outline  Test,"  School  Review,  Vol.  32,  pp. 757 -773 
1924. 

A test  of  the  ability  of  the  student  to  read  end  com- 
prehend the  thought  of  an  author. 
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McClusky,  H.  Y. , and  Curtis,  F.  D., 

"A  Modified  Form  of  the  True-False  Test,”  Journal  of  Educa- 
tional Research,  Vol.  14,  pp.  213-225.  1926 

McCormick,  Partick  J. 

Catholic  University  Pedagogical  Series,  The  History  of 
Education.  The  Catholic  Ed.  Press,  Washington  D.  C.  page  71 
tfcLeod,  Or,  and  Irving  H., 

"Objective  Examinations  in  the  Rural  Schools  of  Wyoming," 
Journal  of  Educational  Research  Vol.  17,  pp. 45-49.  1928. 

VIcMurry,  Charles  A.  et  al, 

Public  School  Methods,  Vol.  3,  Chao.  4,  Chicago  School  Methqjds 
Co.  p.  107.  1913. 

. . . "The  chief  function  of  a test  is  to  determine  what 
a pupil  knows.”  They  show  pupils  their  deficiencies,  warn 
against  failure,  indicate  wherein  instruction  has  been  weak, 
and  outline  needs  fcr  further  work. 

"Formal  tests  of  the  pupils*  acquirements,  made  at  set 
times  and  covering  the  whole  field  of  study,  are  almost  a 
necessity  in  grading,  and  have  a strong  educative  influence. 
Newkirk,  Louis  Vest  1901, 

Tests  and  measurements  in  industrial  education,  by  L.  V. 
Newkirk. . ,H.  A.  Greene... N.  Y.  J.  Wiley  and  Sons,  Inc. 

London,  Chapman  and  Hall  Limited.  1935. 
pewton  and  Treet, 

Greek  History,  Outline  for  Review  Am.  Book  Co.,  Chicago,  190|f 
poll,  Victor, 

MEASURING  SCIENTIFIC  THINKING  Teachers  College  Record,  May 
1934.  Pp.  685-689. 
pygard,  P.  H., 

"Advantages  of  the  probable  Error  of  Measurement  as  a 
Criterion  of  Reliability  of  a test  or  Scale."  Journal  of 
Educational  Psychology  14:  407-13.  October  1923. 
fpdell.  C.  W., 

"Another  Criticism  of  Test  Requiring  Alternative  Responses. 
Journal  of  Educational  Research,  Vol  7,  pp.  326-330;  April 
1923. 

Criticizes  those  who  object  to  right -minus -wrong  scoring 
devices  for  two-alternative  responses,  such  as  true-false 
tests,  and  gives  arguments  in  favor  of  such  scoring  methods. 
Also  points  out  the  value  of  such  tests  in  examining  proced- 
ures . 

pdell,  C.  W., 

Educational  Statistics.  The  Century  Co.  334pn.  1925. 

Odell,  C.  W., 

"Objective  Measurement  of  Information,"  University  of  Illino 
Bulletin,  Vol.  23,  No.  36,  Bureau  of  Educational  Research 
Circular,  No.  44,  pp.  27,  1926. 

An  important  discussion  of  thirty-seven  types  of  object 
ive  tests,  with  illustrations. 

Odell,  Charles  Watters,  1891 

...A  selected  annotated  bibliography  dealing  with  examina- 
tions and  school  marks  by  C.  W.  Odell. . .Urbana,  Universit^r 
of  Illinois,  1929. 
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Odell,  C.  W., 

Traditional  examinations  and  ndw-type  tests  New  York,  Cen- 
tury Co.  1928. 

An  excellent  and  very  comprehensive  treatment  of 
school  examination  methods.  This  volume  maintains  a high- 
ly commendable  balance  of  judgment.  There  is  a carefully 
selected  bibliography  of  100  titles. 

Odell, 

Fully  annotated  bibliography  of  300  classified  titles. 
Bulletin  No.  43  of  the  Bureau  of  Educational  Research, 
University  of  Illinois,  January  15,  1929. 

Odell,  C.  W., 

T he  Use  of  Scales  for  rating  pupils'  answers  to  thought 
questions.  Bulletin  No.  46.  Bureau  of  Educational  Researc1 
University  of  Illinois,  May  7,  1929. 

Odell,  C.  W.  1891, 

Educational  measurement  in  high  school.  New  York,  Century 
Co.,  1930. 

Ogan,  R.  W. , and  Ewing,  D.  H., 

"Reducing  Variability  in  Teachers'  Scoring,"  Ohio  State 
University,  Educational  Research  Bulletin,  Vol.  7,  No.  10 
pp.  214-216.  1928. 

It  shows  the  value  of  a set  of  seven  scoring  rules  in 
reducing  the  variability  of  the  marks  of  26  teachers  on  an 
arithmetic  paper. 

Opdyke,  J.  B., 

"Constructive  Examinations . " Educational  Review.  Vol.  73. 
PP.  33-43.  1927. 

Orleans,  Jacob  S., 

Manual  of  instructions  in  objective  tests  for  use  at 
teachers'  conferences.  Albany,  N.  Y. , University  of  the 
State  of  New  York  Press.  Bulletin  No.  902. 

Orleans,  J.  S.  and  Sealy,  G-.  A., 

Objective  Tests,  1928. 

"Orleans  and  Sealy  conducted  an  interesting  coopera- 
tive testing  program  in  the  First  Rural  Supervisory  Distric 
of  Lewis  County,  New  York,  during  the  spring  of  1927.  Theij 
book  is  a report  of  this  testing  project  in  which-  a group 
of  one-  and  two-room  teachers  participated.  The  success  of 
their  undertaking  shows  what  can  be  done  in  cooperative  test- 
ing, even  under  adverse  conditions.  It  shows  clearly  that 
teacher  participation  in  general  examinations  is  a practical 
proposition. " 

Otis,  A.  S., 

Statistical  Method  in  Educational  Measurement.  Uorld  Book 
Co.,  1925.  332pp. 

An  elementary  book  in  statistics,  treated  with  the  nee< 
of  testers  in  mind. 

Ozanne,  C.  E., 

"A  Study  of  Different  Types  of  Teachers'  Tests,"  School 
Review,  Vol.  34,  pp.  54-60.  1926. 

A study  of  the  relative  interests  in  old  and  new  types 
of  examinations. 
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Park,  Maxwell  G-erald  1890, 

Training  in  objective  educational  measurements  for  elemen- 
tary school  teachers,  published  with  the  approval  of  Pro- 
fessor William  C.  Bagley,  sponsor.  New  York  City,  Teachers 
College,  Columbia  University.  1932. 

Parker,  E.  P., 

"A  Few  Suggestions  for  Informal  Testing  in  G-eography,"  El- 
ementary School  Journal,  Vol.  23,  pp.  444-447,  1923* 
Paterson,  D.  G., 

mDo  New  and  Old  Examinations  Measure  Different  Functions?" 
in  School  and  Society,  Vol.  24,  pp.  246-248,  Aug.  21,  1926. 

"Paterson  conducted  an  experiment  which  indicates  that 
the  essay  and  new-type  tests  both  tend  to  measure  the  same 
mental  functions ... .He  found  also  that  the  results  of  the 
new-type  tests  agreed  with  each  other  better  than  the  re- 
sults of  the  two  essay  examinations....  It  was  clear  that, 
in  addition  to  the  two  kinds  of  examinations  measuring  the 
same  thing,  the  new-type  was  measuring  it  better  than  the 
old-type . " 

Paterson,  D.  G-. , 

"improving  the  Examination  Function  in  Teaching."  Report  o 
the  Committee  on  Educational  G-uidance,  Bulletin  of  the  Uni- 
versity of  Minnesota,  Vol.  26,  No.  31,  op.  47-56,  August  4, 
1923. 


A discussion  of  the  claims  for  the  new-type  examina- 
tions, together  with  illustrations  of  different  types  of 
questions  and  some  statistical  evidence  of  the  usefulness 
of  these  examinations  in  the  field  of  psychology. 

Paterson,  D.  G-. , 

The  Preparation  and  Use  of  New-Type  Examinations,  World 
Book  Co.,  1925. 

A very  brief  treatment  of  particular  interest  to  high- 
school  and  college  teachers. 

Paterson,  Donald  G-., 

PREPARATION  AND  USE  OF  NEW-TYPE  EXAMINATIONS , World  Book 
Company,  Yonkers-on-Hudson,  New  York,  1926. 

A manual  for  teachers.  It  gives  definitions  and  prin- 
ciples underlying  adequate  examinations.  Advantages  and 
Disadvantages  of  each  form  of  question  and  a splendid  bib- 
liography. 

Paterson,  Donald  G-ilder sleeve , 

Preparation  and  use  of  new-type  examinations;  a manual  for 
teachers.  Yonkers-on-Hudson,  N.  Y. , Chicago,  World  Book 
Company,  1925. 

Paterson,  D.  G-. , and  T.  A.  Langlis, 

"Empirical  Data  on  the  Scoring  of  True-False  Tests."  Journal . 
of  Applied  Psychology,  Vol*  9,  pp*  339-348,  December,  1925. 
Pathfinder, 

A weekly  magazine  pub.  by  the  Pathfinder  Co.,  2414-16-18 
Douglas  St.,  Washington  D.  C.,  Oct.  10,  1936;  No.  2232,  Oct 
10,  1936. 

At  Yale  a new  system  of  general  examinations,  in  which 
students  will  take  tests  in  their  major  field,  was  announce*. • 
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Patri,  Angelo, 

A SCHOOLMASTER  OP  THE  GREAT  CITY,  Macmillan  Co.  N.  Y. ,1920 
Tells  of  his  father  taking  the  examination  to  become 
an  American  Citizen. 

Paulu,  E.  M. , 

Diagnostic  Testing  and  Remedial  Teaching .Boston , D.  C.  Heat 
and  Co.  1924.  371  pp. 

A treatment  of  the  follow-up  work  after  testing. 

Perry,  W.  M. , 

"Measurement  and  Analysis  of  Student  Achievement  in  a Be- 
ginning Course  in  Educational  Psychology,"  Education,  Vol. 
48,  pp.  12-23.  1927. 

Powers,  S.  R. , 

"A  Comparison  cf  Achievement  of  High  School  and  University 
Students  in  Certain  Tasks  in  Chemistry."  Journal  cf  Educa- 
tional Research,  Vol.  6,  pp.  332-343.  1922. 

This  work  illustrates  the  use  of  the  multiple-choice 
or  recognition  method  in  measuring  certain  abilities  in 
elementary  chemistry  in  high  schools,  colleges,  and  univers 
ities . 

Powers,  S.  R. , 

"Objective  Measurement  in  General  Science,"  Teachers  Colleg 
Record. Vol.  29.  pd.  345-349.  1928. 

Pratt^  H.  G., 

"Proper  Use  of  Educational  Measurements,"  Journal  of  Educa- 
tional  Method,  Vol.  7.  PP.  204-209.  1928. 

Pressey,  S.  L, 

"A  Simple  Apparatus  which  Gives  Tests  and  Scores  and  Teache 
School  and  Society.  Vol.  13.  pp.  373-376,  1926. 

Pressey,  S.  L. , 

"introduction  to  the  Use  of  Standard  Tests",  The  World  Book 
. Company,  1922. 

A book  for  beginners  in  the  field  of  measurement. 
Proctor,  William  M., 

"High  School's  Interest  in  Methods  of  Selecting  Students 
for  College  Admission,"  California  Quarterly  of  Secondary 
Ed.,  Vol.  1,  October,  1925, 

Questions  and  Answers  in  History  of  Education,  given  at  the  uni- 
form examinations  of  the  State  of  New  York  since  first  give: 
18*110  Op.  S.,  Syracuse,  Bardeen,  1906? 

Rake straw,  N.  W. , 

"Objective  Examinations  in  Chemistry."  Report  of  the  New 
England  Association  of  Chemistry  Teachers,  Vol.  28,  No.  5, 
pp.  133-143,  1927. 

A very  thoughtful  discussion  illustrated  by  unusually 
good  concrete  examples  of  objective  test  items  for  cheraistr* 
Reader's  Guide, 

J.  of  Ed.  Method,  Vol.  VI,  No.  5,  Jan.  1927,  P.  230. 

"The  so-called  True-False  type  of  examination  has  now 
been  used  to  an  extent  to  justify  an  attempt  to  refine  the 
technique  of  it." 

Reeve.  W.  D. , 

"New-Type  Tests  in  Teaching  Mathematics."  Teachers  College 
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Record  , Vol.  29,  pp.  693-703,  1928. 

Rules  for  the  construction  of  new-type  tests  togetner 
with  the  criteria  of  good  examinations.  Several  excellent 
test  exercises  are  given. 

Remmers,  H.  H., 

’’The  Relation  Between  Students’  Marks  and  Students’  Atti- 
tudes Toward  Instructors,"  School  and  Society,  Vol.  28, 

PP.  759-760,  1928. 

Remmers,  H.  H.,  L.E.  Marschat,  A.  Brown,  s.nd  I.  Chapman, 

"Experimental  Study  of  the  Relative  Difficulty  of  True-Fals 
Multiple-Choice,  and  Incomplete-Sentence  Types  of  Examina- 
tion Questions.  ' Journal  of  Educational  Psychology,  Vol  14 
No.  6,  pp.  367-372,  September,  1923. 

A preliminary  study  on  some  results  obtained  in  an  ef- 
fort to  determine  the  relative  difficulty  of  these  three 
forms  of  new-type  questions. 

Remmers,  Hermann  Henry  1892, 

. . .Exemption  from  college  semester  examinations  as  a condi- 
tion of  learning,  by  H.  H.  Remmers,  PH.D.,  in  co-operation 
with  the  Departments  of  Mathematics  and  Applied  mechanics, 
Purdue  University,  Lafayette,  Ind.,  1933. 

Remmers,  H.  H.,  and  Remmers,  E,  M. , 

"The  Negative  Suggestion  Effect  of  True-False  Questions," 
in  Journal  of  Educational  Psychology,  Vol.  17,  pp.  52-56, 
January,  1926. 

"Remmers  and  Remmers  carried  on  an  experiment  in  ordep 
to  determine  the  negative-suggestion  effect  of  true-false 
questions.  They  found  no  evidence  of  negative  carry-over 
or  false  associations  from  taking  true-false  tests.  ’ 

Report  of  Commission  on  New-T^/pe  Examinations,  College  Entrance 
Examination  Board,  431  West  117th  St.,  New  York,  Nov. 3, 1923 

A comparison  of  new-type  and  old-type  examinations, 
with  reference  to  reliability  or  internal  consistency  and 
validity  or  the  extent  to  which  each  is  correlated  with 
preparatory-school  marks  and  college  marks.  This  report 
convinced  the  C.  E.  E.  B.  of  the  desirability  and  wisdom  of 
incorporating  new-type  examining  technique  as  a part  of 
their  procedures  in  certain  subjects. 

Rich,  Frank  M. , 

Making  and  Scoring  Unstandardized  Tests,"  Journal  of  Edu-  1 
cational  Method,  Vol.  VIII,  No.  2,  p.  100,  Nov.  1928. 

Prevailing  method ::: "First , the  examiner  draws  up  a 
series  of  questions  intended  to  be  as  nearly  equal  as  pos- 
sible in  difficulty.  Second,  if  easy  questions  are  inserted, 
they  are  grouped  together,  and  two  or  more  credited  as  one. 
Third,  more  questions  are  usually  furnished  than  the  exa- 
miner requires  to  be  answered,  thus  allowing  some  latitude 
of  choice  by  omission  without  loss  of  credit." 

Rich,  S.  G. , 

"Use  of  Standardized  and  Partially  Standardized  Tests  in  a 
Normal  School,"  School  Science  and  Mathematics,  Vol. 23, 
pp.  539-542,  1923. 
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Richards,  0.  W. , 

"High  Test  Scores  Attained  by  Subaverage  Minds."  Journal 
of  Experimental  Psychology,  Vol.  7,  pp.  148-156,  1924. 

Demonstrates  by  statistical  theory  the  probable  scores 
to  be  obtained  on  the  basis  of  guessing  alone  in  tests  with 
two,  three,  and  four  alternative  answers.  Gives  no  consid-* 
oration  to  the  psychological  factors  in  such  tests  which  re 
move  them  from  the  realm  of  pure  chance. 

Richards,  0.  W.,  and  S.  C.  Kohs, 

,lHigh  Test  Scores  Attained  by  Subaverage  Minds."  Journal 
of  Educational  Psychology,  Vol. 16,  No.  1,  Pp. 8-18, Jan. , 1925* 
Demonstrates  by  analysis  of  the  laws  of  chance  that  exl- 
treme  care  must  be  used  in  interpreting  results  derived  from 
true-false  tests  and  recommends  that  a true-false  test  in- 
clude at  least  seventy-five  items  to  obviate  the  chance  er- 
ror in  scores. 

Richards,  0.  W., 

"Test  Construction  in  Less  Standardized  Subjects  Illustrate^, 
by  the  Richard’s  Biology  Test,"  School  Science  and  Mathema-I 
tics,  Vol.  27,  pp.  22-27 , 1927 
Roback,  A.  A., 

"Subjective  Tests  vs.  Objective  Tests,"  Journal  of  Educati- 
onal Psychology,  Vol.  12,  pp.  459-444,  1921, 

Roberts,  H.  M.  and  Ruch,  G-.  M., 

"The  Negative  Suggestion  Effect  of  True-False  Tests,"  Jour- 
nal of  Educational  Research,  Vol. 18, pp. 112-116,  1928. 
Robinson,  E.  B., 

"The  Analysis  of  Trade  Ability,"  Journal  of  Applied  Psycho- 
logy. Vol.  5,  pp.  352-357,  1919. 

Robinson  and  Breasted, 

OUTLINE  OF  EUROPEAN  HISTORY,  Ginn  and  Co. , Boston, pp. 205, 191)4. 
Roetzer,  Helen, 

HISTORY  TESTS  AND  PROCEDURES,  A Masters  Thesis,  1932. 

Rogers,  A.  L. , 

Experimental  Tests  of  Mathematical  Ability  and  their  Prog- 
nostic Value,  Teachers  College,  Columbia  University,  Contrir 
butions  to  Education,  No.  89,  pp.  118,  1918. 


Rogers,  D.  C., 

"The  New-Type  of  Objective  Examination,"  Chicago  Principals 
Club  Reporter,  Vol.  15,  No.  4,  pp.  3-6,  1925. 

Ross,  C.  C., 

The  Diagnostic  Value  of  Individual  Record  Cards,  Teachers 
College,  Columbia  University,  Contributions  to  Education, 
Nol  166,  p.  70,  1925. 

Ruch,  G.  M.,  and  G^  D.  Stoddard, 

"Comparative  Reliabilities  of  Five  Typer  of  Objective  Exam- 
inations," Journal  of  Educational  Psychology,  Vol.  16,  pp. 
103,  1925. 

Ruch,  G.  M., 

"Minimum  Essentials  in  Reporting  Data  on  Standard  Tests." 
Journal  of  Educational  Research,  12:349-58,  December,  1925 
Ruch,  G.  M.  et  al . , 

"Short-Answer  Examinations  in  the  Social  Studies  in  the 
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Elementary  School  Grades,"  Public  Personnel  Studies,  Vol. 4, 
No.  10,  pp.  27^-277.,  1926. 

Ruch,  G.  M.,  and  M.  H.  DeGraff., 

"Corrections  for  Chance  and  ’Guess'  vs.  'Do  Not  Guess'  In- 
structions in  Multiple-Responses  Tests,"  Journal  of  Educati 
onal  Psychology,  Vol.  17,  pp.  368-375,  1926. 

Ruch,  Giles  Murrel,  1892, 

Objective  examination  methods  in  the  social  studies;  a re- 
port of  investigations  carried  out  under  a subvention  from 
the  New  York  Commonwealth  fund,  by  G.  H.  Ruch... and  Mark  H. 
DeGraff,  W.  E.  Gordon. .. (and  others)  Chicago,  Atlanta  (etc) 
Scott,  Foresman  and  Company.  1926. 

Ruch,  G.  M. , 

The  improvement  of  the  written  examination.  Chicago,  111., 
Scott.  Foresman,  and  Co.,  1924. 

"Thi3  boo£  discusses  the  functions  of  written  examina- 
tions, the  criteria  of  a good  examination,  sources  of  error 
in  written  examinations,  types  and  construction  of  the  newep 
objective  examinations,  with  many  examples  of  new-type  ques- 
tions in  various  subjects  and  experimental  studies  of  the 
relative  merits  of  the  forms  of  new-type  examinations." 
Paterson. 

"Ruch'  s conclusions  are  so  important  as  to  justify 
quotation:  '10  or  20  minute  examinations  of  objective  type 
are  very  much  more  reliable  than  5 to  10  question  tradition- 
al examinations  which  require  30  to  60  minutes'  " 

Ruch,  G.  M., 

Patterson,  Donald  G.,  Langlie,  T.  A., 

"The  Improvement  of  Written  Examinations,"  Journal  of  Ap- 
plied Psychology. 

"...Recent  experimental  work  by  Ruch  and  by  Paterson 
and  Langlie  3hows  that  the  right-minus -wrong  formula  con- 
tributes nothing  of  value  to  the  technique  of  true-false 
tests;  on  the  contrary,  it  actually  results  in  lower  relia-j 
bility  coefficients  than  simply  scoring  by  number  right." 
Ruch,  G.  M. , and  Mark  H.  DeGraff, 

"Corrections  for  Chance  and  Guess  vs.  'Do  Not  Guess'  Instrub 
tions  in  Multiple-Response  Tests."  Journal  of  Educational 
Psychology  17,  pp.  368-375,  September,  1926. 

Ruch  and  G.  P.  Stoddard, 

Tests  and  measurements  in  high  school  instruction.  Yonkers 
New  York,  World  Book  Co.,  1927. 

A treatment  of  the  standard  tests  for  secondary  school^ 
but  containing  a section  on  objective  testing. 

Ruch,  G.  M.,  and  J.  W.  Charles, 

"A  Comparison  of  Five  Types  of  Objective  Tests  in  Elementary 
Psychology,"  Journal  of  Aoplied  Psychology,  Vol.  12,  pp.398- 
403,  1928. 

Ruch,  G,  M., 

The  objective  or  new-type  examination.  Chicago  111.,  Scott 
Foresman  and  Co.,  1929. 

An  introduction  to  educational  measurement,  by  G.  M. 
Ruch. . .Chicago,  N.  Y. , (Etc. ) "General  Bibliography "p. 447 -71. 
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Hugs 


, H.  0., 

"Statistical  Methods  Applied  to  Education,  Houghton  Mifflip 
Company,  Boston,  1925. 

A Book  which  explains  and  illustrates  the  uses  and 
methods  of  statistics. 


Ruml , B. , 

' "The  Extension  of  Selection  Tests  to  Industry",  Annals  of 

the  American  Academy  of  Political  Science.  Vol.  81,  No. 170, 
pp."'3S^7  1919. 

Russell,  Charles, 

Classroom  Tests,  G-inn  and  Co.,  Boston,  1926. 

A very  elementary  but  full  discussion  of  the  building 
of  a series  of  objective  tests  by  a group  of  Toledo,  Ohio, 
teachers.  Very  little  critical  or  experimental  material. 
Rutledge,  R.  E., 

"The  True-False  Examination  in  Elementary  Psychology  with 
Suggestions  for  its  Improvement,"  Ph.D,  Thesis,  University 
of  California,  1926. 

Rynearson,  Edward, 

"Guidance  in  the  Pittsburgh  Public  Schools."  Twenty-third 
Year  Book  of  the  National  Society  for  the  Study  of  Education.. 
Sandiford,  Peter, 

"The  Standardization  of  Tests  and  Scales,"  Journal  of  Edu- 
cational Research,  7; 14-27,  January,  1923. 

Sanford,  Vera., 

"A  New*Type  Final  Geometry  Examination. " Mathematics  Tea- 
cher, Vol.  18,  No.  1,  pp.  22-37,  January,  1925. 

Describes  the  development  of  a new-type  geometry  exam- 
ination in  Lincoln  School  of  Teachers  College,  together  with 
statistical  evidence  of  its  reliability  and  validity. 

Sangren,  Paul  V., 

"State  and  National  Testing  Programs,"  in  "Educational  Tests! 
and  Their  Uses,"  Review  of  Educational  Research,  Vol.  No.  5, 
pp.  456-458,  December,  1935. 

School  Survey, 

For  surveys  which  have  employed  standard  achievement  tests 
in  various  school  subjects  see  the  topic,  "The  Measurement 
of  Instruction, "Topical  Analysis  of  234  School  Surveys,  by 
Henry  L.  Smith,  Bulletin  of  the  School  of  Education,  Indians, 
University,  III,  No.  4,  pp.  75-82,  March  1927. 

Bloomington  Ind. : Bureau  of  Cooperative  Research. pp. Ill  * 
School  Survey, 

"The  South  Carolina  Every-Pupil  Testing  Program,  Containing 
Announcement  of  the  First  Annual  Testing  Program,  May  4-8,  1936." 
School  Survey, 

"State-Wide  Achievement  Testing  Programs,"  in  "Estimating 
State  School  Efficiency,"  Research  Bulletin  of  the  National 
) Education  Association,  X,  No.  13,  pp.  97-103,  May,  1932. 

Includes  a bibliography  of  forty  references  on  state- 
wide achievement  testing. 

School  Survey, 

"Fitting  the  School  to  the  Pupil,"  by  Paul  R.  Mort,  Wendell 
W.  Wright,  and  W.  B.  Featherstone . Report  of  the  Survey  of 


l 


( 


. 


I 


. 


, 


. 


. 


* 

t 

. 

. 

. • < 

: 

- 


- 

. , - * , 


~ 

n 


. 


. 


. 

, 

. 


, < » 

- 

. 

. 


. 


t * 


. 


. ' 

. 


'• 


. 


198 


the  Schools  of  Chicago,  111.,  Vol.2,(5  vols.)pp.  3-l4l. 

"Summary  of  Findings  and  Recommendations,"  by  George 
D.  Strayer,  Teachers  College,  Columbia  University,  pp.  72- 
86,  1932. 

School  Survey, 

REVIEW  OF  EDUCATIONAL  RESEARCH,  V,  No.  5,  p.460,Dec.  1935. 
Schryoch,  R.  H., 

"New  Tests  for  Old,"  Historical  Outlook,  Vol.  14,  pp.  319- 
322,  1923. 

Schutte,  T.  H., 

"Is  There  a Value  in  Final  Examinations?"  in  Journal  of  Ed- 
ucational Research,  Vol.  12,  pp.  204-213,  October,  1925. 

"Final  examinations  also  may  be  effective  in  stimula- 
ting thorough  work.  A study  by  Schutte  provides  some  expert 
imental  evidence  of  this.  For  t wo  years  Schutte  divided  a 
class  into  two  comparable  sections.  There  were  one  hundred 
students  in  each  section.  The  work  of  both  sections  was  a- 
like  in  every  detail  except  that  one  section  was  advised 
that  there  would  be  a final  examination  and  the  other  was 
told  that  in  lieu  of  a final  examination  their  grades  would 
be  based  entirely  upon  their  daily  work. ...  Shu tte  comes  to 
the  tentative  conclusion  that  final  examinations  produce 
worthwhile  results.  The  stimulation  of  daily  work  is  an  im- 
portant function  of  examinations." 

Seashore,  C.  E., 

"College  Placement  Examinations."  School  and  Society,  Vol. 
20,  No.  515,  pp.  575-580,  November  8,  1924. 

Describes  the  Iowa  Placement  Examinations  in  English, 
French,  Mathematics,  and  Chemistry,  which  utilize  the  mul- 
tiple-choice or  recognition  question,  and  advocates  their 
experimental  use  in  sectioning  students  into  homogeneous 
groups  on  the  basis  of  ability. 

Seashore,  C.  E. , 

"Progressive  Adjustment  vs.  Entrance  Elimination  in  a State 
University,"  School  and  Society,  Vol. 17, No. 420, Jan. 13, 1923. 

Advocates  the  use  of  objective  examinations  to  make 
college  marks  more  reliable,  so  that  they  may  be  used  more 
safely  in  educational  guidance. 

Segel,  David, 

National  and  State  Cooperative  High-School  Testing  Programs 
U.  S.  Office  of  Education  Bulletin,  No.  9,  Washington  D.  C. 
Page  47,  1933. 

Sharp,  S.  E., 

AMERICAN  JOURNAL  OF  PSYCHOLOGY,  Vol .X, (Wore ester , Mass, 1899] 


Sharp.  L.  A., 

"The  Value  of  Standards  in  Grading  Examinations,"  Peabody 
Journal  of  Education,  Vol.  3,  No.  1,  pp.  38-45,  1925. 

Adoption  of  a set  of  scoring  rules  reduced  the  varia- 
bility of  grading  arithmetic  papers  by  eighty  per  cent. 

Shen,  Eugene, 

"A  Note  on  the  Standard  Error  of  the  Spearman  Brown  Formula. 
Journal  of  Educational  Psychology  17,  pp.  93-94,  February, 
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Sherman,  J.  H., 

"is  the  Examination  Worth  Retaining?"  School  and  Society 
Vol.  27,  pp.  694-696,  1928. 

He  finds  the  examination  so  worth  while  that  he  re- 
commends all  grading  upon  such  a basis. 

Shulson,  V. , and  C.  C.  Crawford, 

"Experimental  Comparison  of  True-False  and  Completion  Tests',' 
Journal  of  Educational  Psychology,  Vol. 19, pp. 580-83,  1928. 

The  completion  test  lacks  objectivity  but  is  as  valid 
as  the  true-false.  The  latter  is  easier,  if  not  corrected 
for  chance,  but  more  difficult  if  scored  right-minus -wrong, 
Skinner,  A.  W., 

"Examinations  and  Tests,"  High  School  Quarterly,  Vol.  14, 
pp.  174-179,  1926. 

Concludes  that  old  and  new  types  have  their  special 
advantages  and  that  both  are  needed. 

Smith,  E.  L. , 

A Critical  Analysis  of  Rating  Sheets  Now  in  Use  for  Rating 
Student-Teachers.  Educational  Administration  and  Super- 
vision, XXII,  pp.  179-189,  March,  1936. 

The  author  presents  an  analysis  of  the  rating  sheets 
used  by  103  colleges  and  universities,  members  of  the  North 
Central  Association  of  Secondary  Schools  and  Colleges. 

Smith,  Henry  Lester, 

Wright,  Wendell  William, 

Bulletin  of  The  School  of  Education,  Indiana  University. 
Second  Revision  of  the  Bibliography  of  Educational  Measure-)- 
ments . 

An  Excellent  reference. 

Smith,  Henry  Lester,  and  Wendell  W.  Wright, 

Tests  and  Measurements,  Silver,  Burdett,  and  Co. ,p. 540, 1928. 
Smith,  G-ale , 

How  to  Construct  and  Use  Non-Standardized  Tests,  Chanters 
V1-1X,  Fowler,  Ind. , 1929. 

Smith.  Henry  L., 

"The  Measurement  of  Instruction,"  Topical  Analysis  of  234 
School  Surveys.  Bulletin  of  the  School  of  Education,  Ind- 
iana University,  III  (March,  1927)  No.  4,  Bloomington,  Ind!*: 
Bureau  of  Cooperative  Research,  pp.III, 

Smith.  H.  L.,  and  W.  W.  Wright, 

"Second  Revision  of  the  Bibliography  of  Educational  Measure- 
ments," Bulletin  of  the  School  of  Education,  Indiana  Uni- 
versity, Vol.  4,  No.  2,  November  1927,  p.  251. 

The  most  complete  and  useful  bibliography  of  education- 
al tests  which  has  appeared  to  date  (1927).  Approximately 
one  thousand  titles  are  listed,  together  with  short  des- 
criptions of  each  test. 

Smith,  H.  L. , and  W.  W.  Wright, 

Tests  and  Measurements.  New  York,  Silver,  Burdett,  and  Co., 

57W,  1925. — — 

Perhaps  the  most  modern  and  best  balanced  treatment,  of 
the  subject  available.  T he  authors  have  shown  more  ten- 
dency to  depart  from  tradition  than  almost  any  other  writers. 
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.and  W.  . 7/right 


Smith.  D.  E., 

"On  Imoroving  Alegebra  Tests,"  Teachers  College  Record, 

Vol.  24,  pp.  87-94.  1923 

Smith,  Henry  Lester  1876, 

Tests  and  measurements,  by  H.  L.  Smith. 

Silver  Burdett  and  Co.  N,  Y.  1928 
Smith,  Henry  Lester,  Wright  Wendell  William, 

Second  Revision  of  the  Bibliography  of  Educational  Measure-1 
ments.  Bulletin  of  the  School  of  Education,  Indiana 
University,  IV  No.  2 (Nov.  1927)  Bloomington,  Ind. : Bureau 
of  Cooperative  Research,  Pp.  251. 

Social  Studies  of  the  American  Historical  Association,  Report 

of  the  Commission  on  Conclusions  and  Recommendations  of  the 
Commission.  Charles  Scribner's  Sons.  Pp.  96-101,  168.1934 
Somers,  Grover  T., 

STUDENTS'  ATTITUDE  TOWARD  EXAMINATIONS . Bureau  of  Coopera-i 
tive  Research,  Indiana  University  School  of  Education. 
Bloomington,  Indiana.  Vol. Ill  No.l.  September  1926. 

"The  attitude  cf  the  Experimental  group  in  comparison 
with  the  Control  group  improved  somewhat.  They  reflected 
growth  in  their  conception  of  the  purpose  and  function  of 
tests  and  examinations,  and  "Drifts"  in  their  attitudes 
otherwise  indicate  decreased  hostility  toward  them." 


Somers 


T. 


Pedagogical  Prognosis.  Teachers  College,  Columbia  Universi' 
.^Contributions  to  Education,  No.  140,  pp. 25-51,  57ff.,  1924. 

’ Albert  Plympton,  1855, 

Dime  question  books.  Syracuse,  N.  Y.  C.  W.  Bardeen,  1899- 
1900. 

Spencer,  P.  L. , 

"The  Improvement  of  Teaching  by  Means  of  Home  Made  Non- 
standardized  Diagnostic  Tests  and  Remedial  Instruction, " 
School  Review,  Vol.  31,  pp.  276-281,  1923. 

A very  thoughtful  discussion  of  diagnostic  and  remedial 
teaching  through  well-made  tests. 

Spence,  Ralph  B., 

A Comprehensive  Testing  Pro.  for 
Record.  Jan.  1933. 

Spencer,  Roger  A. 

The  Work  of  the  School  Principal  in  Supervision.  El.  School 
J.  Vol.  20.  pp.  176-187.  Nov.  1919. 

The  standard  test  is  the  best  means  of  eliminating 
poor  method. s and  poor  work.  It  is  objective  and  its  result 
can  be  discussed  in  an  imnersonal  wav. 

Stack.  H.  J., 

"Standardized 


El.  Schs.  Teachers 


Collegej 


in  Community 
Vol.  18,  pp. 


and  Economic  Civics." 

166-172.  1927. 


Tests 

Historical  Outlook, 

Starch,  D.  Eliot,  E.  C., 

.'Reliability  of  Grading  High  School  Work  in  Mathematics," 
in  School  Review,  Vol.  21,  pp.  254-59.  (April,  1913) 

...Starch  and  Eliot  selected  a plane-geometry  examina- 
tion paper  for  grading.  Geometry  was  selected  because  of 
the  common  assumption  that  mathematics  papers  are  graded 
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with  mathematical  precision.  The  had  118  teachers  of  math-j 
ematics  grade  the  plane-geometry  paper.  These  teachers 
gave  the  paper  marks  ranging  from  28  to  92  per  cent.  They 
also  had  a history  examination  paper  graded  by  70  teachers 
of  history,  who  gave  it  grades  ranging  from  43  to  90  per- 
cent." The  experiment  show s that  teachers  vary  greatly  in! 
the  marks  which  they  assign  an  examination  paper,  and  that! 
they  vary  about  as  much  in  one  subject  as  in  another. 
Starch,  Daniel, 

"Educational  Measurements."  Macmillan  Go. 

An  earlier  book  on  the  subject. 

Starch,  D.  and  Eliot,  E.  C., 

"The  Reliability  of  Grading  High  School  Work  in  English," 
in  School  Review,  Vol.  20,  pp. 442-57.  September  1912. 

"The  studies  of  Starch  and  Eliot  have  become  the 
classic  reference  on  the  variation  of  teachers’  marks  for 
essay  examination  papers.  In  one  experiment  they  took. the 
papers  written  by  two  students  on  a comprehensive  examina- 
tion in  high-school  English.  These  teachers  gave  one  paper 
grades  ranging  from  64  to  98  percent;  and  the  other  grades  j 
ranging  from  50  to98  percent. " These  papers  were  also 
graded  by  students.  The  experiment  shows  that  teachers 
vary  greatly  in  the  marks  which  they  assign  an  examination  |j 
paper . 

Stenquist,  J.  L. , 

"Measurement  of  Mechanical  Ability,"  Teachers  College, 
Columbia  University,  Contributions  to  Education,  No.  130, 
1923 

Stern,  L.  W. , 

DIE  D IFF TRENT IT LLE  PSYCHOLOGIS  (Leipzig,  1911) 

Stocks,  E.  H., 

"The  Use  of  the  True-False  Examination  at  Smith  College," 
School  and  Society .Vol . 22,  p.  655,  1925. 

Stormzand,  M.  J., 

American  History  Teaching  aa  d Testing, New  York,  The 
Macmillan  Company,  1926  181  pp. 

Chapter si, 11, 111, XXiv  and  XXV  deal  with  examinations, 
marks,  new-type  tests,  etc.,  with  special  reference  to  in 
struction. 

Strang,  Ruth, 

Teachers  College  Record  Vol.  XXXV,  No.  2,  Columbia  Univers- 
ity. Pp.  12Q-133.  Nov.  1933. 

"...Scientific  research  leads  eventually  to  practical 
uses,  and  practical  research  becomes  a complement  or  a 
consequent  of  its  more  respected  antecedent . " 

Strayer,  George  D., 

Is  Scientific  Accuracy  Possible  in  the  Measurement  of  the 
Efficiency  of  Instruction?  EDUCATION  Vol.  34,  No.  4,  pp, 
248-249.  Dec.  1913. 

..."The  examination  as  it  existed  and  as  we  have  it 
today,  is  the  most  obvious  method  employed  in  judging  the 
efficiency  of  instruction." 


i 


Strayer.,  George  D. , 

"Summary  of  Findings  and  Recommendations, " Report  of  the 
Survey  of  the  Schools  of  Chicago,  Illinois.  Vol.  1 (5Vols.) 
Teachers  College,  Columbia  University.  Pp.  72-86.  1932. 
Strickland,  V.  L, 

"Objective  tests,"  Kansas  State  Agricultural  College, 
Manhattan,  Kansa,  Bulletin  XV111,  No.  2 
Stuart,  Milo  H.,  and  Mort  Paul  R., 

"Economy  in  Reporting  and  Recording  Pupil  Ratings."  Teachers 
College  Record,  Vol.  29,  No.  3,  Dec.  1927. 

Stump,  N.  F., 

Oral  versus  printed  methods  in  the  presentation  of  the  truest 
false  examination.  Journal  of  educational  research,  18: 
423-24.  Dec.  1928. 

Sutherland,  A.  H., 

"Tests  in  Reading  as  a Part  of  Classroom  Routine,  " Nineteen-} 
th  Yearbook  of  the  National  Society  for  the  Study  of  Educa- 
tion, Part  1,  pp.  47-51.  1920 

Symonds,  P.  M. , 

"Needed  Research  in  the  Field  of  Measurement  in  Secondary 
Education,"  Journal  of  Educational  Research,  Vol.  16,  pp. 
119-127.  1927. 

An  excellent  summary  of  the  high  points  of  the  work 
done  to  date  in  high-school  testing  with  several  lists  of 
needed  researches,  eighty  such  being  suggested. 

Symonds,  P.  M.,  1893 

Measurement  in  Secondary  Education,  Macmillan  Co.  Boston 
1927. 

An  excellent  treatment  of  standard  tests  for  high 
schools.  Mention  is  made  of  objective  tests,  teachers  marks!,, 
limitations  of  the  traditional  examination,  etc. 

Symonds,  P.  M. , 

"Factors  Influencing  Test  Reliability,"  Journal  of  Educationr 
al  Psychology,  Vol.  19,  pp.  73-87.  1928. 

Perhaps  the  best  discussion  of  the  concept  of  test 
reliability  now  in  print,  especially  for  non-st^tistical 
readers. 

Symonds,  P.  M. , 

Choice  of  items  for  a test  on  the  basis  of  difficulty. 

Journal  of  educational  psychology,  20:  481-93.  Oct.  1929 
Symonds,  P.  M. , 

Tests  and  interest  questionnaires  for  guidance  of  high 
school  students.  New  York  city.  Bureau  of  publications, 
Teachers  college.  Columbia  University,  1930. 

Telford,  F.  (Unsigned) 

"Method  s of  Selecting  Employees  to  Fill  High  Positions  in 
Public  Service,"  Public  Personnel  Studies  Vol.  2,  No. 2, 
pp.  13-58.  1924. 

The  best  statement  in  print  of  the  values  of  and  needs 
for  objective  tests  for  public  employees.  Many  illustrat iv e 
selection  techniques  (including  sample  tests)  are  given. 
Telford,  Fred, 

"The  Work  of  the  Board  of  Examiners  of  the  New  York  City 
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Board  of  Education."  Public  Personnel  Studies 


Pu bl ic  Personnel 
1925: 


Administration  Vol.  2,  No. 9, 


Bureau  of 
Pp.  268-287. 


Dec. 

A detailed  survey  of  the  work  of  this  board  of  examiners 
indicating  that  the  board  has  incorporated  the  shop  t-answer 
form  of  question  in  its  examining  procedures.  See  other 


instances  of  the  use 
examinations . 


the  Binet-Simon  ScsL  e; 
G.  Lyman,  Geo.  Ordahlj 


Houghton  Mifflin  Go.  p.  17, 


issues  of  Public  Personnel  Studies  for 
of  new-type  questions  in  civil  service 
German  - Lewis  Madison  1877, 

The  Stanford  revision  and  extension  of 
for  measuring  intelligence,  by  Terman, 
and  others. 

Tharp.  J,  B., 

"The  New  Examination  Versus  the  Old  in  Foreign  Language," 
School  and  Society,  Vol.  26,  pp.  691-695.  1927. 

Thomas,  W.  M., 

"Committee  Marking  of  Examinations,"  New  York  Bulletin  of 
High  Points,  Vol.  6,  pp.  26-28,  1925. 

Holds  that  committee  marking  is  not  sufficient  better 
than  individual  marking  to  justify  its  use. 

Thomas,  F.  V., 

Principles  and  Technique  of  Teaching,  pp.  379-80.  Boston 
1927. 

Thomas,  Frank  W., 

Training  for  Effective  Study, 

1922. 

Open -book  examinations.  These  allow  pupils  to  use  any 
textbooks  v/hile  working  on  the  question  which  not  only  testsi 
memorization  of  fact  but  the  applications  of  facts  studied. 
Thorndike,  E.  L. , 

An  Introduction  to  the  Theory  of  Mental  and  Social  Measure- 
ments. Second  edition. Teachers  College  Columbia  University 
1919. 

"Experience  has  sufficiently  shown  that  the  facts  of 
human  nature  can  be  made  the  material  for  quantitive  science 
...It  is  the  aim  of  this  book  to  introduce  students  to  the 
theory  of  mental  measurements  and  to  provide  them  with  such; 
knowledge  and  practice  as  to  assist  them  to  follow  critically 
quantitative  evidence  and  argument  and  to  make  their  re- 
searches exact  and  logical." 

Thorndike,  E.  L., 

"Completion  Tests  in  Physics, " School  Science  and  Mathematics 
Vol.  22,  pp. 637-657.  1922. 

Thorndike,  E.  L. , 

"Entrance  Exams  and  College  Grades." 

Vol.  23,  pp.  839-845  1906. 

A more  detailed  presentation  and  analysis  of  the  sta- 
tistical data  forming  the  basis  of  the  preceding  article. 
Thorndike,  E.  L. , 

"The  Future  of  the  College  Entrance  Examination  Board." 
Educational  Review,  Vol.  31,  PP*  470-479.  1906. 

A Statistical  analysis  of  the  weaknesses  of  tradition-  jj 
al  examination  methods  as  used  by  the  C.E.E.B.,  showing  low 
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correlations  between  entrance  examinations  and  college  markg. 
Thorndike  concludes,  "it  is  certain  that  the  traditional  en- 
trance examinations,  even  when  as  fully  safeguarded  as  in 
the  case  of  those  given  by  the  College  Entrance  Examination  |j 
Board,... do  not  measure  fitness  for  college  well  enough  to  j; 
earn  the  respect  of  students  or  teachers,  and  do  intolerable 
injustice  to  individuals." 

Thorndike,  Edward  L. , 

Means  of  Measuring  School  Achievements  in  Handwriting.  Eb. 

Admin.  & Super.  Vol.  1,  No.  5,  May  1915. 

For  measuring  handwriting  for  quantity  and  quality  of 
the  product  produced  by  children  of  grades4  to  8,  inclusive 
is  now  very  simple.  For  quantity  we  may  use  the  number  of 
letters  written  per  unit  of  time;  and  for  quality,  the  point 
reached  on  the  scale  devised  by  Thorndike  or  the  scale  pub- 
lished later  by  Ayres. 

Thorndike,  Edward  L. , 

Means  of  Measuring  School  Achievement  in  Spelling.  Ed. 

Admin.  & Super.  Vol.  1,  No.  4,  April,  1915. 

Achievement  in  spelling  may  best  be  considered  as  the 
overcoming  of  two  sets  of  difficulties  - difficulties  in 
spelling  per  se . , and  dif f erculties  in  acquaintance  with 
words. 

Thorndike,  E.  L. , 

"Tie  Measurement  of  Achievement  in  Drawing."  Teachers 
College  Record.  Fp.  545-385.  Nov.  1913. 

Thorndike,  E.  L. , 

"The  Nature,  Purposes,  and  General  Method  of  Measurements 
of  Educational  Products, " Seventeenth  Yearbook  of  the 
National  Society  for  the  Study  of  Education,  Part  11,  1918. 
Thurstone,  L.  L. , and  Thurstone,  Thelma  G. , 

"The  1935  Psychological  Examinations,"  The  Educational 
Board,  (April,  1936),  pp.  296-318. 

A tabulation  of  the  results  from  the  1935  edition  of  j 
the  American  Council  Psychological  Examination  for  266 
Colleges  and  58,  402  students. 

Tiegs,  Ernest  Walter, 

Tests  and  measurements  for  teachers.  Houghton  Mifflin  Co. 

3oston.  1931. 

Toops,  H.  A., 

"A  General  Science  Test."  School  Science  and  Mathematics, 

Vol.  25,  pp.  317-022.  1925. 

Toops,  H.  A., 

"How  to  Construct  an  Objective  Test,"  School  Science  and 
Mathematics,  Vol.  25,  pp.  817-822.  1925. 

Toops,  Herbert,  1895, 

Test3  for  vocational  guidance  of  children  10-16.  Columbia 
University,  N.Y.C.  1923. 

Toops,  H.  A. , 

Trade  Tests  in  Education.  Contributions  to  Education,  No. 

115.  Teachers  College  Columbia  University,  N.  Y.  118  pages' 

1921. 
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An  excellent  dissertation  demonstrating  the  adaption  of  the 
technique  of  trade-test  construction  to  the  preparation  of 
school  examinations. 

Toops,  H.  A., 

"What  are  We  Failing  to  Measure?"  Journal  of  Educational 
Research,  Vol.  13,  pp.  118-129,  1926, 

Torgerson,  T.  L. , and  others. 

The  7/isconsin  Plane  G-eome  try  test.  The  Wisconsin  Algebra 
Test,  7/he  7/isconsin  Biology  Test,  The  Wisconsin  General 
Science  Test,  The  Wisconsin  American  History,  and  the  7/is- 
consin Language  Usage  Test,  (E.  M.  Hale  and  Co.,  1936) 

A series  of  schievement  tests  employed  as  a part  of 
the  statewide  testing  program  carried  on  jointly  by  the 
School  of  Education,  the  Department  of  Mathematics  of  the 
University  of  Wisconsin  and  the  Wisconsin  State  Dept,  of 
Public  Instruction. 

Trabue,  M.  R. , 

"What  shall  we  Expect  of  Educational  Tests?"  in  Teachers 
College  Record,  Vol. 26,  p.lll,  October  1924. 

"Dr.  Trabue  has  sized  the  situation  up  correctly  when 
he  says  that  '...the  diagnosis  of  specific  educational  di- 
seases and  the  long  experimentation  to  discover  whether  for 
a certain  type  of  pupii  more  drill  on  forms  will  be  helpful 
or  fatal  - the  'case  work*  which  constitutes  the  next  step 
in  the  use  of  educational  measurements  - must  be  done  in  th4 
classroom  by  the  regular  teacher.'" 

Trabue,  M.  R. , 

Measuring  Results  in  Education.  New  York,  The  American  Book 
Co. , p.  492,  1924. 

An  extended  treatment  with  special  reference  to  the  us$s 
of  test  results  in  bettering  classroom  instruction. 

Try on,  R.  M., 

"Standard  and  New-Type  Tests  in  Social  Studies,"  Historical 
Outlook,  Vol.  17,  pp.  172-178,  1927. 

Tyler,  R.  W., 

Constructing  achievement  tests.  Columbus,  Ohio,  Bureau  of 
educational  research,  Ohio  State  University,  1934, 

Tyler.  Ralph  W. , 

"Evaluation:  A Challenge  and  an  Opportunity  to  Progressive 
Education,"  Educational  Record,  XVI  (January,  1935/ ,PP*122-$1, 
The  appraisal  of  education  outcomes  other  than  the  for 
mal  ones  is  treated  in  the  next  chapter  of  this  book  under 
the  topic,  "Observation  of  Behavior"  and  "Appraisal  Proced- 
ures" as  well  as  in  the  section  on  "Questionnaire  Inquiries" 
with  follows. 

Upton,  Clifford  B«, 

Mathematics  Teacher,  The  Influence  of  Standardized  Tests 
on  the  Curriculum  in  Arithmetic,  p.  193-208,  April  1925. 
Upton,  C,  B., 

"Standardized  Tests  in  Mathematics  for  Secondary  Schools," 
by  Professor  C.  B.  Upton.  Chapter  Xlll  of  the  Report  of  th^ 
National  Committee  on  Mathematical  Requirements. 

The  field  of  tests  and  measurements  as  applied  to  the 
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teaching  of  elementary  and  secondary  mathematics  has  devel- 
oped rapidly  during  the  past  few  years.  There  are  an  ex- 
haustive list  of  books  on  the  subject.  For  a complete  des- 
cription of  the  various  tests  and  a bibliography  see  chap- 
ter Xlll . 

U.  S.  War  Department,  Adjutant  Gene ral's  Office,  "The  Making  of 

a Trade  Test,”  Personnel  Bulletin,  Vol.  1,  No .7 , pp. 25-28, 193-8. 
Van  Buskirk,  L. , 

’’Measuring  Results  of  Physical  Education',’  Journal  of  Educa- 
tional Method,  Vol,  7,  pp.  221-229,  1928. 

Van  Wagenen,  M.  J., 

Educational  Diagnosis,  New  York,  The  Macmillan  Co.,  p.276,1926. 

As  the  title  suggests,  the  book  deals  with  actual  pro- 
blems of  measuring  and  classigying  pupils,  together  with 
corrective  work  arising  from  the  application  of  tests. 

Various , 

"New-Type  Examinations  Questions"  (Library  Methods),  Sumner 
Library  Institute,  University  of  Chicago,  1926. 

Various, 

"Objective  Test  Number,"  The  High  School.  School  of  Educa- 
tion University  of  Oregon,  Vol. 4,  pp. 119-158,  1927. 

An  excellent  collection  of  objective  tests  for  almost 
all  high-school  subjects. 

Various, 

"Tests  in  History  and  the  Social  Studies,"  Historical  Out- 
look, Nov.  1923. 

Practically  the  entire  issue  of  this  journal  is  devoted 
to  examples  of  objective  tests. 

Vincent,  John  H.,  and  James  R.  Roy, 

Greece,  Outline  History  of,  Chautauqua  Press,  Copyright  188^ 
by  Phillips  and  Hunt,  805  Broadway,  New  York. 

Wait,  W.  T., 

"Objective  Measurements  of  Results  of  Solid  Geometry,"  School 
Science  and  Mathematics,  Vol,  17,  — • 969ff,  1927* 

Walker,  H.  M. 

"Certain  Mathematical  Questions  Suggested  by  the  True-False 
Test,"  American  Mathematical  Monthly,  Vol.  34-,  No.  10,  pp. 

503-515,  1927. 

An  excellent  but  highly  mathematical  consideration  of 
the  true- false  test. 

Waples,  D., 

"The  BEst-Answer  Exercise  as  a Teaching  Device,”  Journal  of 
Educational  Research,  Vol.  15,  pp.  10-22,  1927. 

Suggests  the  best  answer  test  as  a measure  of  the  or- 
ganization of  data,  and  gives  a number  of  illustrations. 
Wardner,  Charles  A., 

"Educational  and  Vocational  Guidance  in  the  Public  Schools 
of  Jackson,  Mich."  Twenty -Third  Year  Book  of  the  National 
Society  for  the  Study  of  Education. 

Webb,  Louie  Winfield,  1883, 

Standard  tests  in  the  elementary  school  nursery  school  to 
sixth  grade,  by  L.  W.  Webb. .. .and  Anna  Markt  Stotwell,  New 
York,  R.  Long  and  R.  R.  Smith,  Inc.,  1932. 
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Webb,  H.  A., 

"Testing  Laboratory  Resourcefulness,"  School  Science  and 
Mathematics,  Vol.  22,  pp.  259-267.  1922. 

Weidemann,  C.  0., 

"Determinate  vs.  Indeterminate  Information  in  Written  Ex- 
aminations," Journal  of  Educational  Method,  Vol.  7, 
pp.  126-127.  1927. 

Veidermann,  C . C . , 

How  to  construct  the  true-false  examination.  New  York  City! 
Teachers  college  Columbia  University,  (Contributions  to 
education.  No.  225,  *26) 

One  of  the  most  comprehensive  studies  of  the  true- 
false  test  yet  available.  It  contains  considerable  ex- 
perimental work. 

Weidemann,  C.  C., 

"Limitations  of  the  True-False  Statement."  Journal  of  Educa- 
tional Method,  Vol.  7,  pp.  214-215,  1928. 

Weidemann,  C.  C.,  and  7/ood,  B.  D., 

"A  Survey  of  College  Examinations,"  Bureau  of  Collegiate 
Research,  Columbia  University,  April  1,  1926. 

We inland,  J.  Eu , 

"A  Note  on  the  Right-’Prrong  Examination,"  Journal  of  Educa- 
tional Psychology,  Vol.  18,  pp.  266-268,  1927. 

Weiss.  A.  ?., 

"On  Methods  of  Mental  Measuremoit,  Especially  in  School  and 
College."  Journal  of  Educational  Psychology,  Vol.  2,  pages 
555-563;  1911. 

Presents  a method  of  obtaining  comparable  scores  from 
different  tests,  utilizing  data  obtained  by  the  completion-1; 
test  method,  comprising  two  objective  quizzes  given  to  a 
sectidn  of  the  class  in  the  Introduction  to  Psychology. 

This  is  a reference  to  some  of  the  earliest  experiments  in 
the  use  of  objective  examination  methods  in  college  teach- 
ing. 

Weld,  L.  D. , 

"A  Standard  of  Interpretation  of  Numerical  Grades,"  School 
Review,  Vol.  25,  po.  412-421.  1917. 

West,  P.  V., 

"A  Critical  Study  of  the  Right -Minus -Wrong  Method,"  Journal 
of  Educational  Research,  Vol.  8,  po.  1-9,  1923. 

Whipple,  Guy  M. , 

"The  Improvement  of  Educational  Research."  School  and 
Society  26;  249-59,  Aug.  27,  1927. 

White,  E.  E., 

The  Elements  of  Pedagogv,  American  Book  Co.,  New  York  oages 
193-205.  1886. 
i Whitten,  C.  W., 

"Report  on  Standardizing  Teachers’  Marks,"  Sixth  Yearbook 
of  the  National  Association  of  Secondary  School  Principals. ! 
1922,  Menasha,  Wisconsin,  The  George  Banta  Publishing  Co. 

pp.  183-202. 

Recommends  the  abandonment  of  percentage  numerical 
grades  in  favor  of  an  A,B,C,D,  and  E,  system. 
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W igmore , J . 11  • > 

"The  ’New-Tvpe’  Law  Examination,  Illinois  Lav;  Review,  Vol. 
19,  pp.  172-173,  1923. 

Wigmore,  J.  H., 

"The  'New  Type'  Law  Examination,  " Illinois  Law  Review,  Vol 
19,  No.  3,  pages  172-173;  Nov.  1924. 

A letter  from  Dean  Wigmore,  Northwestern  University, 
to  the  editor,  counting  himself  in  favor  of  the  new-type 
examination,  having  tried  it  in  three  subjects  for  two  year 
but  taking  issue  with  Een  D.  Wood'  s recent  article,  "The 
Measurement  ofLaw  School  'York, "by  criticizing  the  right- 
minus-wrong  scoring  formula  for  true-false  questions  becaus! 
this  formula  holds  only  for  averages  and  may  in  a given  cas 
be  in  error.  Hypothetical  data  only  are  used  as  the  basis 
of  reasoning. 

Wilkins,  L.  A., 

"Suggestions  as  to  the  Formulation  of  Questions  in  Stand- 
ardized Examinations  in  Modern  Languages,"  Nev;  York  Bulleti 
of  High  Points  Vol.  5,  No.  4,  pp.  27-35.  1923. 

Wilson,  C-.  M.  and  Hoke,  K.  J., 

Hov;  to  Measure  Macmillan  Co.  N.  Y.  1931 

An  excellent  text  book  which  every  teacher  should 
read  and,  if  possible,  own, 

Wilson,  H.  B. , 

"Character  Education,"  California  Quarterly  of  Secondary 
Education,  Vol.  XI. 

Wilson,  H.  E., 

"The  Continuity  Test  in  History  Teaching,"  School  Review, 
Vol.  34,  pp,  679-684,  1926. 

Wilson,  W.  R. , Welsh,  G-.  G-ulliksen,  H«, 

"An  Evaluation  of  Some  Information  Questions,"  Journal  of 
Applied  Psychology,  Vol.  Vlll,  No.  2,  pages  206-214;  June 
1924. 

"Questions  covering  every  phase  of  the  course  should 
be  utilized  to  insure  wide  sampling  of  pupil  knowledge... 
’Weighting’  of  questions  according  to  difficulty  or  import- 
ance is  rendered  unnecessary  in  new-type  examinations." 

This  summary  includes  twenty-two  directions. 

W i tham , Ernest  C . , 

All  the  Elements  of  Handwriting  measured.  Ed.  Admin.  & 
Super.  Vol.  1,  No.  5,  May  1915. 

During  the  past  five  years  the  measurement  of  hand- 
writing has  received  considerable  attention  from  two  source 
(l)  The  professors  of  educational  psychology  and  (2)  super- 
intendents and  Teachers. 

Wood,  Benjamin  DeKalbe,  1894, 

New  York  experiments  with  new -type  modern  language  tests, 
including  a survey  of  modern  language  achievement  in  the 
junior  high  schools  of  New  York  City,  June  1925;  the  regent; 
experiment  of  June,  1925,  with  new-type  tests  in  French, 
German,  Spanish  and  Physics,  with  a fore  word  by  the  com- 
missioner of  education,  of  New  York  State,  and  a second 
survey  of  modern  language  achievement  in  the  junior  high 

• 

3 

3 

3 

1 

5 

5 

* 


209 


schools  of  New  York  City,  June  1926.  THE  MACMILLAN  CO.,  1927. 
Wood,  Ben  D, , 

"The  Measurement  of  College  Work."  Educational  Administrate 
tion  and  Supervision,  pp.  301-331,  Sept.,  1921. 

A detailed  report  of  the  results  of  the  new-type  ex- 
amining technique  as  applied  in  contemporary  civilization, 
Columbia  College.  The  facts  presented  in  this  report  ap- 
pear again  in  "food’s  book,  Measurement  in  Higher  Education 
Wood,  Ben  D, , 

"The  Measurement  of  College  Work,"  in  Educational  Adminis- 
tration and  Supervision,  Vol.  7,  pp*  301-304  (Sept.  1921). 

"The  futility  of  grading  essay  examination  papers  is 
indicated  further  by  Wood's  report  of  a group  of  history 
professors  at  Columbia  University,  who  were  grading  historj 
examination  papers  during  the  summer  of  1920.  He  reports 
that  one  of  the  five  or  six  experts,  after  grading  a few 
papers,  made  out  what  he  considered  a model  paper  for  his 
guidance.  This  paper  became  lost  among  the  others.  Later i 
the  "lost  model"  turned  up  with  grades  given  to  it  by  the 
other  graders  ranging  all  the  way  from  40  to  90  per  cent. 

Numerous  other  experiments  could  be  cited  to  show  thaf 
essay  examination  grades  depend  more  upon  the  scorer  than 
upon  the  persons  taking  the  examination. " 

Wood,  Ben.D., 

"Measurement  in  Higher  Education,"  World  Book  Company, 
Yonkers -on -Hudson,  New  York,  xi.  p.  337,  1923. 

A detailed  account  of  the  Columbia  College  experiments 
with  the  Thorndike  Intelligence  Examination  and  the  New- 
Type  Content  Examinations . This  is  probably  the  most  irapor-f 
tant  single  reference  on  the  use  of  new-type  examinations 
in  various  college  subjects. 

Another  comment  is  that  Wood's  work  is  especially  help- 
ful in  connection  with  both  the  old  and  the  new  type  of 
tests  and  examinations. 

Wood,  Ben  D. , 

MEASUREMENT  IN  HIG-HER  EDUCATION,  pp.  162-163,  World  Book 
Co.,  1925. 

"...Every  experimental  study  thus  far  made  and  reported 
has  shown  a very  high  relationship  between  measurements  of 
information  in  a field  and  intelligence  or  ability  to  thinl{ 
in  the  material  of  that  field." 

"...In  the  absence  of  scientific  analyses  of  objectives 
in  most  courses,  we  may  define  the  function  to  be  measured 
in  school  examinations  as  knowledge  of,  and  ability  to  thirst 
in,  the  subject  matter  of  the  various  courses.  This  definition 
is  a modification  of  Ben  D.  Wood's  definition  of  the  func- 
tion of  college  examinations  as  being  'knowledge  of,  and 
ability  to  think  in,  the  materials  of  the  course,'  as  giveif 
in  his  book,  MEASUREMENT  IN  HIG-HER  ED.  (World  Book, Co.,) 
page  153. 

A helpful  book  in  connection  with  tests. 

Wood,  Ben  D., 

"The  Measurement  of  Law  School  Work,"  Columbia  Law  Review, 
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Vol.  24,  No.  3,  March,  1924;  and.  Vol.25,No.3,  March,  1925. 

An  account  of  ths  application  of  objective  tests  in 
law  course,  together  with  the  opinions  of  the  instructors 
in  charge. 

Wood,  Ben  D. , 

"The  Measurement  of  Law  School  Work,"  Columbia  Law  Review, 
Vol.  24,  No.  3,  p.  42,  March,  1924. 

Presents  experimental  evidence  of  the  need  for  and  thfc 
value  of  new-type  content  examinations  in  law  schools. 

V/ ood,  B.  D. , 

"New  Type  Examinations  in  the  college  of  Physicians  and 
Surgeons,"  Journal  of  Personnel  Research,  October-November 

1926,  op.  227-235,  and  pp.  277-283. 

Accounts  of  pioneer  work  in  applying  the  new-type  ex- 
amination in  college  classes  in  professional  schools.  Of 
especial  interest  to  college  teachers. 

Wood,  Ben  D. 

New  York  Experiments  with  the  New -Type  Modern  Language 
Tests.  Publications  of  the  Am.  and  Canadian  Committees  on 
Modern  Languages,  Vol.l,  N.  Y. , The  Macmillan  Co.,pp.339, 

1927. 

Wood,  Ben  D. , 

"The  Reliability  and  Difficulty  of  the  College  Entrance 
Examination  Board  in  Algebra  and  Geometry,"  College  Entrance 
Examination  Board,  431,  West  117th  St.,  New  York,  1920. 

A detailed  statistical  report  of  an  investigation  conr 
cerning  the  reliability  and  difficulty  of  the  C.E.E.B.’s 
traditional  examining  procedures  in  algebra  and  geometry, 
with  recommendations  for  the  partial  adoption  of  new-type 
technique.  This  report  led  the  C.E.E.B.  to  appoint  a com- 
mittee of  its  own  to  investigate  the  claims  for  the  new- 
type  examination. 

Wood,  Ben  D., 

"Studies  of  Achievement  Tests,"  Journal  of  Educational  Psy* 
chology,  17:1-22,  125-39,  Jan.,  Feb.,  1926. 

Wood,  B.  D., 

"Studies  of  Achievements  Tests,"  Journal  of  Educational  Psy- 
chology, Vol.  17,  pp.  1-22,  125-139,  and  263-269,  1926. 

Wood,  E.  P., 

"improving  the  Validity  of  Collegiate  Achievement  Tests," 
Journal  of  Educational  Psychology,  Vol.  18,  pp. 18-25, 1927* 
Wood y.  C.  W. , 

"informal  Tests  as  a Means  for  the  Improvement  of  Instruc- 
tion," First  Yearbook .Department  of  Elementary  School  Prin^ 
cipals,  N.  E.  A.,  pp.87-94,  1922, 


A discussion  which  will  well  repay  reading. 

Woody,  Clifford,  et  al., 

Quantitative  measurement  in  institutions  of  higher  learning. 
Eighteenth  yearbook  of  the  National  society  of  college  tea* 
chers  of  education.  Chicago,  University  of  Chicago  press, 
Ch. VIII , 1930. 

Woody , Clifford,  and  Sangren,  Paul  V., 

Administration  of  the  Testing  Program.  Yonkers-on -Hudson, 


I 


New  York:  World  Book  Go.,  pp.  397,  1932. 

’’Designed  to  serve  as  a manual  of  instruction  for 
those  having  the  responsiblity  of  directing  a testing  pro- 
gram. " 

Worcester,  D.  A., 

"Prevalent  errors  in  New-Type  Examinations,"  Journal  of 
Educational  Research,  Vol.  18,  pp.  48-52,  1928. 

A great  many  pitfalls  are  listed  with  concrete  examples 
A very  important  discussion  for  the  beginner  at  objective 
testing. 

Wright,  H.  C., 

"Some  True -False  Examinations  for  Use  in  General  Mathemat- 
ics," Mathematics  Teacher,  Vol. 28,  pp.  83-91,  1925* 

Wright,  Wendell  William, 

THE  DEVELOPMENT  AND  USE  OF  A COMPOSITE  ACHIEVEMENT  TEST, 
Bulletin  of  the  School  of  Education,  Indiana  University, 
Bloomington,  Indiana,  Vol.  V,  No.  3,  January,  1929. 

"The  state  of  Indiana  had  for  some  time  found  it  ad- 
vantageous to  use  state-wide  examinations  for  promotion 
from  the  elementary  school  to  the  high  school. .. .Other 
states  that  give  state-wide  examinations  are  using  to  a 
limited  degree  new-type  examinations  or  standard  tests.  Thb 
County  Superintendents’  Association  voted  to  replace  the 
essay  typo  examination  with  a new-tvpe  or  standard  test  to! 
be  known  as  the  Indiana  Composite  Achievement  Test. 

Yerkes,  R.  M., 

"Psychological  Examining  in  the  U.  S.  Army,"  Memoirs  of  th^ 
National  Academy  of  Sciences,  Vol.  15,  pp.  305-339,  1921. 
Washington,  Government  Printing  Office. 
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